Apr 14 01:34:16 user devstack@n-api.service[61834]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 01:34:16 user devstack@n-api.service[61834]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 01:34:16 2023] *** Apr 14 01:34:16 user devstack@n-api.service[61834]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 01:34:16 user devstack@n-api.service[61834]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 01:34:16 user devstack@n-api.service[61834]: nodename: user Apr 14 01:34:16 user devstack@n-api.service[61834]: machine: x86_64 Apr 14 01:34:16 user devstack@n-api.service[61834]: clock source: unix Apr 14 01:34:16 user devstack@n-api.service[61834]: pcre jit disabled Apr 14 01:34:16 user devstack@n-api.service[61834]: detected number of CPU cores: 12 Apr 14 01:34:16 user devstack@n-api.service[61834]: current working directory: / Apr 14 01:34:16 user devstack@n-api.service[61834]: detected binary path: /usr/bin/uwsgi-core Apr 14 01:34:16 user devstack@n-api.service[61834]: your processes number limit is 63637 Apr 14 01:34:16 user devstack@n-api.service[61834]: your memory page size is 4096 bytes Apr 14 01:34:16 user devstack@n-api.service[61834]: detected max file descriptor number: 2048 Apr 14 01:34:16 user devstack@n-api.service[61834]: lock engine: pthread robust mutexes Apr 14 01:34:16 user devstack@n-api.service[61834]: thunder lock: enabled Apr 14 01:34:16 user devstack@n-api.service[61834]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 01:34:16 user devstack@n-api.service[61834]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 01:34:16 user devstack@n-api.service[61834]: Python main interpreter initialized at 0x56465d05e990 Apr 14 01:34:16 user devstack@n-api.service[61834]: python threads support enabled Apr 14 01:34:16 user devstack@n-api.service[61834]: your server socket listen backlog is limited to 100 connections Apr 14 01:34:16 user devstack@n-api.service[61834]: your mercy for graceful operations on workers is 90 seconds Apr 14 01:34:16 user devstack@n-api.service[61834]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 01:34:16 user devstack@n-api.service[61834]: *** Operational MODE: preforking *** Apr 14 01:34:16 user devstack@n-api.service[61834]: *** uWSGI is running in multiple interpreter mode *** Apr 14 01:34:16 user devstack@n-api.service[61834]: spawned uWSGI master process (pid: 61834) Apr 14 01:34:16 user devstack@n-api.service[61834]: spawned uWSGI worker 1 (pid: 61835, cores: 1) Apr 14 01:34:16 user devstack@n-api.service[61834]: spawned uWSGI worker 2 (pid: 61836, cores: 1) Apr 14 01:34:16 user devstack@n-api.service[61834]: spawned uWSGI worker 3 (pid: 61837, cores: 1) Apr 14 01:34:16 user devstack@n-api.service[61834]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 01:34:17 user devstack@n-api.service[61835]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 01:34:17 user devstack@n-api.service[61836]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 01:34:17 user devstack@n-api.service[61837]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 01:34:20 user devstack@n-api.service[61837]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 01:34:20 user devstack@n-api.service[61837]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 01:34:20 user devstack@n-api.service[61837]: and ``live_migration_inbound_addr`` respectively. Apr 14 01:34:20 user devstack@n-api.service[61837]: ). Its value may be silently ignored in the future. Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 01:34:20 user devstack@n-api.service[61835]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 01:34:20 user devstack@n-api.service[61835]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 01:34:20 user devstack@n-api.service[61835]: and ``live_migration_inbound_addr`` respectively. Apr 14 01:34:20 user devstack@n-api.service[61835]: ). Its value may be silently ignored in the future. Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61837) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 01:34:20 user devstack@n-api.service[61836]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 01:34:20 user devstack@n-api.service[61836]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 01:34:20 user devstack@n-api.service[61836]: and ``live_migration_inbound_addr`` respectively. Apr 14 01:34:20 user devstack@n-api.service[61836]: ). Its value may be silently ignored in the future. Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: INFO dbcounter [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Registered counter for database nova_api Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61835) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG oslo_db.sqlalchemy.engines [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61837) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writer thread running {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61836) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG nova.context [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e086e9f0-6c9d-428f-aa45-eca1382cde59(cell1) {{(pid=61837) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:34:20 user devstack@n-api.service[61837]: INFO dbcounter [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Registered counter for database nova_cell0 Apr 14 01:34:20 user devstack@n-api.service[61837]: INFO dbcounter [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Registered counter for database nova_cell1 Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG oslo_db.sqlalchemy.engines [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61837) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:20 user devstack@n-api.service[61835]: INFO dbcounter [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Registered counter for database nova_api Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writer thread running {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:20 user devstack@n-api.service[61837]: DEBUG oslo_db.sqlalchemy.engines [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61837) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:20 user devstack@n-api.service[61836]: INFO dbcounter [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Registered counter for database nova_api Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG oslo_db.sqlalchemy.engines [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61835) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writer thread running {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG oslo_db.sqlalchemy.engines [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61836) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:20 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writer thread running {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG nova.context [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e086e9f0-6c9d-428f-aa45-eca1382cde59(cell1) {{(pid=61835) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG nova.context [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e086e9f0-6c9d-428f-aa45-eca1382cde59(cell1) {{(pid=61836) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:34:21 user devstack@n-api.service[61835]: INFO dbcounter [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Registered counter for database nova_cell0 Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:34:21 user devstack@n-api.service[61835]: INFO dbcounter [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Registered counter for database nova_cell1 Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:34:21 user devstack@n-api.service[61836]: INFO dbcounter [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Registered counter for database nova_cell0 Apr 14 01:34:21 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writer thread running {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG oslo_db.sqlalchemy.engines [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61835) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:21 user devstack@n-api.service[61836]: INFO dbcounter [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Registered counter for database nova_cell1 Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writer thread running {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG oslo_db.sqlalchemy.engines [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61835) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:21 user devstack@n-api.service[61837]: INFO dbcounter [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Registered counter for database nova_cell0 Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG oslo_db.sqlalchemy.engines [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61836) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writer thread running {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG oslo_db.sqlalchemy.engines [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61836) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:21 user devstack@n-api.service[61837]: DEBUG oslo_db.sqlalchemy.engines [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61837) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:21 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writer thread running {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writer thread running {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writer thread running {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:21 user devstack@n-api.service[61835]: INFO dbcounter [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Registered counter for database nova_cell0 Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG oslo_db.sqlalchemy.engines [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61835) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:21 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writer thread running {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:21 user devstack@n-api.service[61836]: INFO dbcounter [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Registered counter for database nova_cell0 Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG oslo_db.sqlalchemy.engines [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61836) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 01:34:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writer thread running {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 01:34:21 user devstack@n-api.service[61837]: WARNING keystonemiddleware.auth_token [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 01:34:21 user devstack@n-api.service[61837]: WARNING keystonemiddleware.auth_token [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 01:34:21 user devstack@n-api.service[61836]: WARNING keystonemiddleware.auth_token [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 01:34:21 user devstack@n-api.service[61836]: WARNING keystonemiddleware.auth_token [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 01:34:21 user devstack@n-api.service[61837]: WARNING keystonemiddleware.auth_token [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 01:34:21 user devstack@n-api.service[61837]: WARNING keystonemiddleware.auth_token [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 01:34:21 user devstack@n-api.service[61837]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56465d05e990 pid: 61837 (default app) Apr 14 01:34:21 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:34:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001719 Apr 14 01:34:21 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 01:34:21 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:34:21 user devstack@n-api.service[61835]: WARNING keystonemiddleware.auth_token [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 01:34:21 user devstack@n-api.service[61835]: WARNING keystonemiddleware.auth_token [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 01:34:21 user devstack@n-api.service[61836]: WARNING keystonemiddleware.auth_token [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 01:34:21 user devstack@n-api.service[61836]: WARNING keystonemiddleware.auth_token [None req-b576a830-0bc2-45aa-a30f-e6a8c9502e8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 01:34:21 user devstack@n-api.service[61836]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56465d05e990 pid: 61836 (default app) Apr 14 01:34:22 user devstack@n-api.service[61835]: WARNING keystonemiddleware.auth_token [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 01:34:22 user devstack@n-api.service[61835]: WARNING keystonemiddleware.auth_token [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 01:34:22 user devstack@n-api.service[61835]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56465d05e990 pid: 61835 (default app) Apr 14 01:36:28 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-37934891-026b-40e3-be51-a3aa3adb11f7 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001504 Apr 14 01:36:28 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:28 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:28 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:28 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:28 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:28 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:28 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c1978ba9-00fe-48fb-852f-d2844d79ec8d admin admin] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:28 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c1978ba9-00fe-48fb-852f-d2844d79ec8d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.440217 Apr 14 01:36:28 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 01:36:28 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002002 Apr 14 01:36:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:30 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:30 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:30 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:30 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:30 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:31 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-068ec63a-9784-4e14-b974-e38611dc7d09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:31 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-068ec63a-9784-4e14-b974-e38611dc7d09 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.322042 Apr 14 01:36:31 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:30 2023] POST /compute/v2.1/flavors => generated 405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:31 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-312a5671-fb55-4dc4-b78c-ce0cc1d85955 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:31 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-312a5671-fb55-4dc4-b78c-ce0cc1d85955 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055176 Apr 14 01:36:31 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 01:36:31 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:33 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:33 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002172 Apr 14 01:36:33 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:33 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:33 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b9ff160e-0705-4914-ac21-9179a0b163e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:33 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b9ff160e-0705-4914-ac21-9179a0b163e4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.129405 Apr 14 01:36:33 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:33 2023] POST /compute/v2.1/flavors => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:33 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a64eee66-2c68-4aec-9773-8cd675aa7d8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:33 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-a64eee66-2c68-4aec-9773-8cd675aa7d8c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034274 Apr 14 01:36:33 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 01:36:33 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:35 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001699 Apr 14 01:36:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:35 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-cf238f9c-a877-4fb0-8a9a-707c126c8e88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "swap": 0}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-cf238f9c-a877-4fb0-8a9a-707c126c8e88 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059895 Apr 14 01:36:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:35 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-56a507ac-845a-489e-ac20-66fa9c1d9960 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-56a507ac-845a-489e-ac20-66fa9c1d9960 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026353 Apr 14 01:36:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 01:36:35 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:37 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:37 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001594 Apr 14 01:36:37 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:37 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d180ac86-ab88-4249-9e5f-6480de8f305f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d180ac86-ab88-4249-9e5f-6480de8f305f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064669 Apr 14 01:36:38 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:37 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e0efada9-690f-442f-9c13-6cdb4aa72678 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e0efada9-690f-442f-9c13-6cdb4aa72678 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025513 Apr 14 01:36:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 01:36:38 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:40 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001423 Apr 14 01:36:40 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:40 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-99e999a1-071e-4e73-93b7-f05e11dff1fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "swap": 0, "id": "d4", "vcpus": 4}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-99e999a1-071e-4e73-93b7-f05e11dff1fc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058857 Apr 14 01:36:40 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:40 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:40 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:40 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023453 Apr 14 01:36:40 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 01:36:40 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:42 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f87775fd-1028-4271-90bd-60f75c4160dd None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001480 Apr 14 01:36:42 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:42 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-6e7c7bef-8f5f-4f46-afd7-a89475e750c4 admin admin] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-6e7c7bef-8f5f-4f46-afd7-a89475e750c4 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.069307 Apr 14 01:36:42 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 01:36:42 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:36:43 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001375 Apr 14 01:36:43 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:43 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:43 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:43 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:43 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:43 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:36:44 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-134c90fb-3488-4ab0-84a3-9b6f680266b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "disk": 1}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-134c90fb-3488-4ab0-84a3-9b6f680266b7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.333195 Apr 14 01:36:44 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:43 2023] POST /compute/v2.1/flavors => generated 400 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:44 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d4524980-93da-4191-bc9b-2f1964091931 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:44 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d4524980-93da-4191-bc9b-2f1964091931 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036812 Apr 14 01:36:44 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 01:36:44 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:46 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:46 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001291 Apr 14 01:36:46 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:46 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-63232530-ffdd-4daf-b47f-df9870427658 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:46 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-63232530-ffdd-4daf-b47f-df9870427658 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.079869 Apr 14 01:36:46 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:46 2023] POST /compute/v2.1/flavors => generated 403 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:46 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-618fc3a0-13e3-4e1e-9ceb-2d3e8b812968 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-618fc3a0-13e3-4e1e-9ceb-2d3e8b812968 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027163 Apr 14 01:36:46 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 01:36:46 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:48 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:48 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001345 Apr 14 01:36:48 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:48 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-0adc8300-a269-4ae3-86a2-42afe8a26162 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:48 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-0adc8300-a269-4ae3-86a2-42afe8a26162 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061435 Apr 14 01:36:48 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:48 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-6b8b4cba-5ee3-49f7-b032-0728f75edcfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-6b8b4cba-5ee3-49f7-b032-0728f75edcfb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025337 Apr 14 01:36:48 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 01:36:48 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:50 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:50 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002313 Apr 14 01:36:50 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:50 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:50 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a8b74549-798c-4b1f-a23a-a4e286b57cd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "id": "4", "vcpus": 4, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:50 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a8b74549-798c-4b1f-a23a-a4e286b57cd0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062314 Apr 14 01:36:50 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:50 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:50 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-1b83d944-aa87-43c7-9cce-a64087840f31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-1b83d944-aa87-43c7-9cce-a64087840f31 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024169 Apr 14 01:36:50 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 01:36:50 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:36:52 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:36:52 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001339 Apr 14 01:36:52 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 01:36:52 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:36:52 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2ac9567f-d8a8-4729-8dde-2158c0d581db admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:52 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2ac9567f-d8a8-4729-8dde-2158c0d581db admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.058856 Apr 14 01:36:52 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 01:36:52 2023] POST /compute/v2.1/flavors => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:36:52 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d8d80e5d-30b0-4ad6-a0b9-af4e8b33b5aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:36:52 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d8d80e5d-30b0-4ad6-a0b9-af4e8b33b5aa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023807 Apr 14 01:36:52 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 01:36:52 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:37:23 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:37:23 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-06a22abf-4193-450e-81f8-5f6334987fca admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002156 Apr 14 01:37:23 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 01:37:23 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:37:23 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:37:23 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:37:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:37:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:37:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:37:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:37:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:37:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:37:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.096228 Apr 14 01:37:23 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 01:37:23 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:37:56 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d8d80e5d-30b0-4ad6-a0b9-af4e8b33b5aa admin admin] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:37:56 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d8d80e5d-30b0-4ad6-a0b9-af4e8b33b5aa admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002305 Apr 14 01:37:56 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 01:37:56 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:37:56 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:37:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d6d878dc-5b48-4b6b-9225-c141a054efe3 admin admin] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:37:56 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d6d878dc-5b48-4b6b-9225-c141a054efe3 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.066542 Apr 14 01:37:56 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 01:37:56 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:38:00 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:38:00 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001711 Apr 14 01:38:00 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 01:38:00 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:38:00 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:38:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-cfa76ff8-4e55-47e4-9ba4-cb6153d51d3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "42", "rxtx_factor": 1.0, "swap": 0, "ram": 128, "disk": 1, "name": "m1.nano", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:38:00 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-cfa76ff8-4e55-47e4-9ba4-cb6153d51d3d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064192 Apr 14 01:38:00 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 01:38:00 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:38:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ff0fc78c-4c37-4519-a5b5-f46eda8bb539 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:38:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ff0fc78c-4c37-4519-a5b5-f46eda8bb539 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028374 Apr 14 01:38:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 01:38:00 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:38:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:38:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-cda4c9e6-b0a7-442e-bf65-26132535f74c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002459 Apr 14 01:38:04 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 01:38:04 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:38:04 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-4bcf2bd6-4140-4d8c-a33f-74b32f37c533 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "84", "ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.micro", "swap": 0, "disk": 1}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:38:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-4bcf2bd6-4140-4d8c-a33f-74b32f37c533 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080621 Apr 14 01:38:04 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 01:38:04 2023] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:38:04 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4c6483b1-ee95-4dd1-8e34-80ad97e6cd1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:38:04 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4c6483b1-ee95-4dd1-8e34-80ad97e6cd1c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028964 Apr 14 01:38:04 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 01:38:04 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:40:18 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:18 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:18 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:19 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3d928981-35bf-46a5-b392-ab68e5098765 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Action: 'create', calling method: .version_select at 0x7fd421e69090>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1829426363"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-3d928981-35bf-46a5-b392-ab68e5098765 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.547199 Apr 14 01:40:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 01:40:18 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 1549 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 01:40:20 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-7d0b9f55-20bf-40d8-89db-a015fb26c824 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421eda0e0>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:20 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-7d0b9f55-20bf-40d8-89db-a015fb26c824 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 200 len: 345 microversion: 2.1 time: 0.293302 Apr 14 01:40:20 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:20 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 345 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:21 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-438ac679-d886-4d22-92ac-97f1b71e26a8 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd422087f40>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-438ac679-d886-4d22-92ac-97f1b71e26a8 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 200 len: 346 microversion: 2.1 time: 0.481452 Apr 14 01:40:21 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:21 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 346 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:22 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Action: 'create', calling method: .version_select at 0x7fd421ef8160>, body: {"snapshot": {"volume_id": "afc64947-1680-4abe-b35b-5ba1acebbd76", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-314033233"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:22 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-55fbd4b2-98db-4a6d-a2ec-331fddfe87cf tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.491543 Apr 14 01:40:22 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 16/49] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 01:40:22 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:22 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-613091d3-0399-4df3-b44f-240d874513ae tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d7f010>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-613091d3-0399-4df3-b44f-240d874513ae tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 200 len: 286 microversion: 2.1 time: 0.084597 Apr 14 01:40:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:22 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:22 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4c391c39-3beb-41b1-ae0a-dab755ad611b tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d52560>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4c391c39-3beb-41b1-ae0a-dab755ad611b tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.055313 Apr 14 01:40:22 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 01:40:22 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:22 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-dcc4fdc4-94ed-4096-9e64-8eb627dcd33c tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421ef8ee0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:22 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-dcc4fdc4-94ed-4096-9e64-8eb627dcd33c tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 200 len: 286 microversion: 2.1 time: 0.040519 Apr 14 01:40:22 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:22 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:23 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a118f042-2c8d-45c8-b584-e152367cea11 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d7f760>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:23 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-a118f042-2c8d-45c8-b584-e152367cea11 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 200 len: 286 microversion: 2.1 time: 0.085811 Apr 14 01:40:23 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:23 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-8e732988-cfa9-4738-ad93-55a0688c9b01 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d53910>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-8e732988-cfa9-4738-ad93-55a0688c9b01 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 200 len: 286 microversion: 2.1 time: 0.044549 Apr 14 01:40:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:24 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:25 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-9528b35e-ba0a-491c-89a9-115b6791f807 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421ef88b0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:25 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-9528b35e-ba0a-491c-89a9-115b6791f807 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 200 len: 286 microversion: 2.1 time: 0.034322 Apr 14 01:40:25 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:25 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:26 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-063e215f-9ae4-4027-a688-dd317c6a3ad7 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d7fac0>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:26 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-063e215f-9ae4-4027-a688-dd317c6a3ad7 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 200 len: 287 microversion: 2.1 time: 0.046751 Apr 14 01:40:26 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:26 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:27 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-16dc3858-96a2-46c3-9d96-73970eeaed24 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d53be0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:27 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-16dc3858-96a2-46c3-9d96-73970eeaed24 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 202 len: 0 microversion: 2.1 time: 0.110613 Apr 14 01:40:27 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 01:40:27 2023] DELETE /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:40:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-0530543f-e876-4b15-b22c-0e462c8f2023 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421ef8040>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-0530543f-e876-4b15-b22c-0e462c8f2023 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 200 len: 286 microversion: 2.1 time: 0.042140 Apr 14 01:40:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:27 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:28 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-469377ed-c65c-4197-aeca-573cfed41e19 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d7f2e0>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-469377ed-c65c-4197-aeca-573cfed41e19 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 200 len: 286 microversion: 2.1 time: 0.042010 Apr 14 01:40:28 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:28 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:29 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-72d9a39b-c210-402d-ac71-17b71d6bcb0f tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d53400>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-72d9a39b-c210-402d-ac71-17b71d6bcb0f tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 200 len: 286 microversion: 2.1 time: 0.033755 Apr 14 01:40:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:29 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-971becff-10d6-4edd-85a0-e74adcbfdf02 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421e68af0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-971becff-10d6-4edd-85a0-e74adcbfdf02 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] HTTP exception thrown: Snapshot 8906ce85-d2ea-4c42-aed2-806d97ba71d5 could not be found. Apr 14 01:40:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-971becff-10d6-4edd-85a0-e74adcbfdf02 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Request method failure captured: Apr 14 01:40:30 user devstack@n-api.service[61835]: request: GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 HTTP/1.1 Apr 14 01:40:30 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:40:30 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:40:30 user devstack@n-api.service[61835]: Connection: close Apr 14 01:40:30 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:40:30 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:40:30 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:40:30 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:40:30 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8CMnnxe5VwqowjK-yhWPcCw0jHeZwQa-uzkPPdVUg4U3cFmxqdqeSqio_3G2wqCdzZ6RmssjypeZ65XfrSsHeDIg4leF_oYtj6OF8eUfK7D70ebKeHwSt6noeav3UQLDF6RxKCchnqZBisgfHx5i-bshCOcEY_WTNWCTUbMsaqa9A Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Project-Id: fd81ae5fd4394e8fb708d5ed2f49cc92 Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}] Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Tenant-Id: fd81ae5fd4394e8fb708d5ed2f49cc92 Apr 14 01:40:30 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:30 user devstack@n-api.service[61835]: X-User: tempest-VolumesSnapshotsTestJSON-1111151513-project-member Apr 14 01:40:30 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:40:30 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:40:30 user devstack@n-api.service[61835]: X-User-Id: 20b8062e50d14a24a336de767550fdab Apr 14 01:40:30 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1111151513-project-member Apr 14 01:40:30 user devstack@n-api.service[61835]: method: Apr 14 01:40:30 user devstack@n-api.service[61835]: exception: Snapshot 8906ce85-d2ea-4c42-aed2-806d97ba71d5 could not be found. Apr 14 01:40:30 user devstack@n-api.service[61835]: action_args: {'id': '8906ce85-d2ea-4c42-aed2-806d97ba71d5'} Apr 14 01:40:30 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8906ce85-d2ea-4c42-aed2-806d97ba71d5 could not be found. (HTTP 404) (Request-ID: req-0fda0db5-f02f-4e89-bb64-08f3e243d0af) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8906ce85-d2ea-4c42-aed2-806d97ba71d5 could not be found. Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8906ce85-d2ea-4c42-aed2-806d97ba71d5 could not be found. Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8906ce85-d2ea-4c42-aed2-806d97ba71d5 could not be found. Apr 14 01:40:30 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-971becff-10d6-4edd-85a0-e74adcbfdf02 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Returning 404 to user: Snapshot 8906ce85-d2ea-4c42-aed2-806d97ba71d5 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:40:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-971becff-10d6-4edd-85a0-e74adcbfdf02 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5" status: 404 len: 111 microversion: 2.1 time: 0.038535 Apr 14 01:40:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:40:30 2023] GET /compute/v2.1/os-snapshots/8906ce85-d2ea-4c42-aed2-806d97ba71d5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:40:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-444bcfd4-0265-4af6-9c18-466e1dffdc85 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d7feb0>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-444bcfd4-0265-4af6-9c18-466e1dffdc85 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 202 len: 0 microversion: 2.1 time: 0.092139 Apr 14 01:40:30 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 01:40:30 2023] DELETE /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:40:30 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-65316db8-2f97-4839-bfd5-523bc3af1e6b tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d52dd0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:30 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-65316db8-2f97-4839-bfd5-523bc3af1e6b tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 200 len: 345 microversion: 2.1 time: 0.072416 Apr 14 01:40:30 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:30 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:31 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d746b0f5-6efd-4187-bbf2-698afa028d49 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd4228791b0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:31 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d746b0f5-6efd-4187-bbf2-698afa028d49 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 200 len: 345 microversion: 2.1 time: 0.067602 Apr 14 01:40:31 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 21/64] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:31 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:32 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-efe90b99-2fd7-4000-a85e-5506b2cfdd8c tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d7fd00>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-efe90b99-2fd7-4000-a85e-5506b2cfdd8c tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 200 len: 345 microversion: 2.1 time: 0.094294 Apr 14 01:40:32 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 23/65] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:32 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:33 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-bd222093-c1bb-4ffe-991c-d7eb19b4255f tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d52cb0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:33 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-bd222093-c1bb-4ffe-991c-d7eb19b4255f tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 200 len: 345 microversion: 2.1 time: 0.081483 Apr 14 01:40:33 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:33 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:34 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b9bd001c-c358-4778-a5b0-a3d81ab54de7 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421ef93f0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:34 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b9bd001c-c358-4778-a5b0-a3d81ab54de7 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 200 len: 345 microversion: 2.1 time: 0.076748 Apr 14 01:40:34 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 22/67] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:34 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-021add33-41ff-41e1-9524-6c66410fa795 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d7f520>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-021add33-41ff-41e1-9524-6c66410fa795 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 200 len: 345 microversion: 2.1 time: 0.060672 Apr 14 01:40:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 24/68] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:35 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4c3444ff-ca95-40f0-a8f9-f80e07941ca6 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421d53250>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-4c3444ff-ca95-40f0-a8f9-f80e07941ca6 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] HTTP exception thrown: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4c3444ff-ca95-40f0-a8f9-f80e07941ca6 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Request method failure captured: Apr 14 01:40:36 user devstack@n-api.service[61836]: request: GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 HTTP/1.1 Apr 14 01:40:36 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:40:36 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:40:36 user devstack@n-api.service[61836]: Connection: close Apr 14 01:40:36 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:40:36 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:40:36 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:40:36 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:40:36 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8CMnnxe5VwqowjK-yhWPcCw0jHeZwQa-uzkPPdVUg4U3cFmxqdqeSqio_3G2wqCdzZ6RmssjypeZ65XfrSsHeDIg4leF_oYtj6OF8eUfK7D70ebKeHwSt6noeav3UQLDF6RxKCchnqZBisgfHx5i-bshCOcEY_WTNWCTUbMsaqa9A Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Project-Id: fd81ae5fd4394e8fb708d5ed2f49cc92 Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}] Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Tenant-Id: fd81ae5fd4394e8fb708d5ed2f49cc92 Apr 14 01:40:36 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:36 user devstack@n-api.service[61836]: X-User: tempest-VolumesSnapshotsTestJSON-1111151513-project-member Apr 14 01:40:36 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:40:36 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:40:36 user devstack@n-api.service[61836]: X-User-Id: 20b8062e50d14a24a336de767550fdab Apr 14 01:40:36 user devstack@n-api.service[61836]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1111151513-project-member Apr 14 01:40:36 user devstack@n-api.service[61836]: method: Apr 14 01:40:36 user devstack@n-api.service[61836]: exception: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:36 user devstack@n-api.service[61836]: action_args: {'id': 'afc64947-1680-4abe-b35b-5ba1acebbd76'} Apr 14 01:40:36 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. (HTTP 404) (Request-ID: req-950cb869-16ef-4817-bfb7-a1fa65de0808) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:40:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4c3444ff-ca95-40f0-a8f9-f80e07941ca6 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Returning 404 to user: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:40:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4c3444ff-ca95-40f0-a8f9-f80e07941ca6 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 404 len: 109 microversion: 2.1 time: 0.043564 Apr 14 01:40:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 23/69] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:36 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:40:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-63668b97-63f5-49e6-8e54-9a56e8075409 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421efa050>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:37 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-63668b97-63f5-49e6-8e54-9a56e8075409 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] HTTP exception thrown: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-63668b97-63f5-49e6-8e54-9a56e8075409 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Request method failure captured: Apr 14 01:40:37 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 HTTP/1.1 Apr 14 01:40:37 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:40:37 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:40:37 user devstack@n-api.service[61835]: Connection: close Apr 14 01:40:37 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:40:37 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:40:37 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:40:37 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:40:37 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8CMnnxe5VwqowjK-yhWPcCw0jHeZwQa-uzkPPdVUg4U3cFmxqdqeSqio_3G2wqCdzZ6RmssjypeZ65XfrSsHeDIg4leF_oYtj6OF8eUfK7D70ebKeHwSt6noeav3UQLDF6RxKCchnqZBisgfHx5i-bshCOcEY_WTNWCTUbMsaqa9A Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Project-Id: fd81ae5fd4394e8fb708d5ed2f49cc92 Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}] Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Tenant-Id: fd81ae5fd4394e8fb708d5ed2f49cc92 Apr 14 01:40:37 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:37 user devstack@n-api.service[61835]: X-User: tempest-VolumesSnapshotsTestJSON-1111151513-project-member Apr 14 01:40:37 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:40:37 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:40:37 user devstack@n-api.service[61835]: X-User-Id: 20b8062e50d14a24a336de767550fdab Apr 14 01:40:37 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1111151513-project-member Apr 14 01:40:37 user devstack@n-api.service[61835]: method: Apr 14 01:40:37 user devstack@n-api.service[61835]: exception: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61835]: action_args: {'id': 'afc64947-1680-4abe-b35b-5ba1acebbd76'} Apr 14 01:40:37 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. (HTTP 404) (Request-ID: req-81362187-9822-46d3-992b-3a1ad0e7c75c) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-63668b97-63f5-49e6-8e54-9a56e8075409 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Returning 404 to user: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:40:37 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-63668b97-63f5-49e6-8e54-9a56e8075409 tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 404 len: 109 microversion: 2.1 time: 0.057038 Apr 14 01:40:37 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 23/70] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 01:40:36 2023] DELETE /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:40:37 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-4c0c22d9-e9f6-4142-85e5-c1fff082582a tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Calling method '.version_select at 0x7fd421edb520>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-4c0c22d9-e9f6-4142-85e5-c1fff082582a tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] HTTP exception thrown: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-4c0c22d9-e9f6-4142-85e5-c1fff082582a tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Request method failure captured: Apr 14 01:40:37 user devstack@n-api.service[61837]: request: GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 HTTP/1.1 Apr 14 01:40:37 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:40:37 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:40:37 user devstack@n-api.service[61837]: Connection: close Apr 14 01:40:37 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:40:37 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:40:37 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:40:37 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:40:37 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8CMnnxe5VwqowjK-yhWPcCw0jHeZwQa-uzkPPdVUg4U3cFmxqdqeSqio_3G2wqCdzZ6RmssjypeZ65XfrSsHeDIg4leF_oYtj6OF8eUfK7D70ebKeHwSt6noeav3UQLDF6RxKCchnqZBisgfHx5i-bshCOcEY_WTNWCTUbMsaqa9A Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Project-Id: fd81ae5fd4394e8fb708d5ed2f49cc92 Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd81ae5fd4394e8fb708d5ed2f49cc92"}]}] Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Tenant-Id: fd81ae5fd4394e8fb708d5ed2f49cc92 Apr 14 01:40:37 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1111151513 Apr 14 01:40:37 user devstack@n-api.service[61837]: X-User: tempest-VolumesSnapshotsTestJSON-1111151513-project-member Apr 14 01:40:37 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:40:37 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:40:37 user devstack@n-api.service[61837]: X-User-Id: 20b8062e50d14a24a336de767550fdab Apr 14 01:40:37 user devstack@n-api.service[61837]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1111151513-project-member Apr 14 01:40:37 user devstack@n-api.service[61837]: method: Apr 14 01:40:37 user devstack@n-api.service[61837]: exception: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61837]: action_args: {'id': 'afc64947-1680-4abe-b35b-5ba1acebbd76'} Apr 14 01:40:37 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. (HTTP 404) (Request-ID: req-fa75098d-552a-4120-9da1-9fab39885a9f) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. Apr 14 01:40:37 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:40:37 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-4c0c22d9-e9f6-4142-85e5-c1fff082582a tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] Returning 404 to user: Volume afc64947-1680-4abe-b35b-5ba1acebbd76 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:40:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-4c0c22d9-e9f6-4142-85e5-c1fff082582a tempest-VolumesSnapshotsTestJSON-1111151513 tempest-VolumesSnapshotsTestJSON-1111151513-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76" status: 404 len: 109 microversion: 2.1 time: 0.038548 Apr 14 01:40:37 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 25/71] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:37 2023] GET /compute/v2.1/os-volumes/afc64947-1680-4abe-b35b-5ba1acebbd76 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:40:39 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-107707434", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "93155729-11d3-4eff-bbd2-8860a881e233"}]}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:39 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] validate_networks() for [('93155729-11d3-4eff-bbd2-8860a881e233', None, None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:40:40 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2013173860", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "365cbeec-3756-4258-a135-04112bdda4b4"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:40 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] validate_networks() for [('365cbeec-3756-4258-a135-04112bdda4b4', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Getting quotas for project 907f632263e04bf2a6c8ff1bae77a5c7. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Getting quotas for user 236828e284154097a25f59eaedf47c29 and project 907f632263e04bf2a6c8ff1bae77a5c7. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:40:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:40:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.406436 Apr 14 01:40:41 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 24/72] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:40:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 2409 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:40:41 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-72c8e5c3-ca1f-4544-a79a-cf576e45401e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:41 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-72c8e5c3-ca1f-4544-a79a-cf576e45401e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:40:41 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-72c8e5c3-ca1f-4544-a79a-cf576e45401e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:40:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-72c8e5c3-ca1f-4544-a79a-cf576e45401e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a" status: 200 len: 1210 microversion: 2.1 time: 0.169817 Apr 14 01:40:41 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 26/73] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:40:41 2023] GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a => generated 1210 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting quotas for project 219c39c8299e46368012a947fdfbe5fd. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting quotas for user 7ed01a83531f4c6bb18a4593284baf05 and project 219c39c8299e46368012a947fdfbe5fd. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:40:42 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:40:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.809962 Apr 14 01:40:42 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 24/74] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 01:40:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 01:40:42 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-cb9577d3-feea-453e-969c-e312ff9fdfb7 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:42 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-cb9577d3-feea-453e-969c-e312ff9fdfb7 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:40:42 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-cb9577d3-feea-453e-969c-e312ff9fdfb7 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:40:43 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-cb9577d3-feea-453e-969c-e312ff9fdfb7 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:40:43 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-cb9577d3-feea-453e-969c-e312ff9fdfb7 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:40:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-cb9577d3-feea-453e-969c-e312ff9fdfb7 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85" status: 200 len: 1395 microversion: 2.87 time: 0.431083 Apr 14 01:40:43 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 25/75] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:40:42 2023] GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85 => generated 1395 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:40:43 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1756590565", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "fc6463bc-9492-414e-930d-3c5dc5ae31a0"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:43 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] validate_networks() for [('fc6463bc-9492-414e-930d-3c5dc5ae31a0', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:40:44 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4a62e175-bd3d-4402-9bd0-15e2307252a4 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421cb8670>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:44 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d55c567b-4e7c-45f7-aeb6-83011e57ebbb tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Action: 'create', calling method: .version_select at 0x7fd421c38310>, body: {"keypair": {"name": "tempest-keypair-1599380679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClEbUZCS4BNpBa3d/c+E5gxA0W0UKOCjR2aXoCFkSjH1TtZ7VyBn5ergCTIl3tkCVYAq22i3BavCcYyS+Tyc9WpPRWr8ud0N+f5IiF1KOJhw1hKiESl8P8LoB9KVFwn9Q=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:44 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4a62e175-bd3d-4402-9bd0-15e2307252a4 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6448ba63-3837-41ef-bb75-176c1562f669" status: 200 len: 350 microversion: 2.1 time: 0.085500 Apr 14 01:40:44 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 26/76] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:44 2023] GET /compute/v2.1/os-volumes/6448ba63-3837-41ef-bb75-176c1562f669 => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:44 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-d55c567b-4e7c-45f7-aeb6-83011e57ebbb tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Getting quotas for project 4833ddea1fa74866b97ef52a730605aa. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:40:44 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-d55c567b-4e7c-45f7-aeb6-83011e57ebbb tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Getting quotas for user f09ab986a00f43b384cf5d517857a13d and project 4833ddea1fa74866b97ef52a730605aa. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:40:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d55c567b-4e7c-45f7-aeb6-83011e57ebbb tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193831 Apr 14 01:40:44 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 25/77] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:40:44 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Getting quotas for project 50fbd5c190254145815a39079b57881c. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Getting quotas for user 2fae797718f548fba18e7bc01829f489 and project 50fbd5c190254145815a39079b57881c. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:40:45 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:40:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.245888 Apr 14 01:40:45 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 27/78] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:40:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:40:45 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-b2eb9307-f795-4797-b6b2-8556a930a4ed tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:45 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b2eb9307-f795-4797-b6b2-8556a930a4ed tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:40:45 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-b2eb9307-f795-4797-b6b2-8556a930a4ed tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fae797718f548fba18e7bc01829f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fbd5c190254145815a39079b57881c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:40:45 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b2eb9307-f795-4797-b6b2-8556a930a4ed tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820" status: 200 len: 1209 microversion: 2.1 time: 0.162915 Apr 14 01:40:45 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 27/79] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:40:45 2023] GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 => generated 1209 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:40:45 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-1cd75047-7999-48d9-ae79-d9ea0c09ffa3 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421c383a0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:46 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-1cd75047-7999-48d9-ae79-d9ea0c09ffa3 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/133f3844-7bc4-4bce-88c9-de5fb01dd86c" status: 200 len: 349 microversion: 2.1 time: 0.058759 Apr 14 01:40:46 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 26/80] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:45 2023] GET /compute/v2.1/os-volumes/133f3844-7bc4-4bce-88c9-de5fb01dd86c => generated 349 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-32759c0a-4b4a-4c3a-a33a-cc646a1eaadc tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421cc44c0>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-32759c0a-4b4a-4c3a-a33a-cc646a1eaadc tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/61190ed3-dd15-4a87-84fb-99edfb2d8008" status: 200 len: 350 microversion: 2.1 time: 0.082545 Apr 14 01:40:48 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 28/81] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:40:48 2023] GET /compute/v2.1/os-volumes/61190ed3-dd15-4a87-84fb-99edfb2d8008 => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:48 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-614e295a-0934-42dc-9d6e-592d6d0e24ee tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421cb9090>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:48 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-614e295a-0934-42dc-9d6e-592d6d0e24ee tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.136126 Apr 14 01:40:48 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 28/82] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 01:40:48 2023] GET /compute/v2.1/os-volumes => generated 1032 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:40:48 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-e3337401-ef50-4643-97a6-ddb942565704 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421c39bd0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:48 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-e3337401-ef50-4643-97a6-ddb942565704 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.094501 Apr 14 01:40:48 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 27/83] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 01:40:48 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-4b18ba6b-31a7-4547-be1d-38ff68922b5c tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421cc4b80>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-4b18ba6b-31a7-4547-be1d-38ff68922b5c tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.088290 Apr 14 01:40:48 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 29/84] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 01:40:48 2023] GET /compute/v2.1/os-volumes => generated 1032 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:40:48 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c48722ab-1e74-4539-b928-e0469669f0df tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421c77130>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c48722ab-1e74-4539-b928-e0469669f0df tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.097535 Apr 14 01:40:49 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 29/85] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 01:40:48 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f33fd39c-f843-47c5-a347-d64d8e2c8a23 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421c3a950>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:49 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1267413302", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "95555a4e-9d95-4509-a683-f61ea2dc38a1"}], "security_groups": [{"name": "tempest-securitygroup--1138473141"}], "key_name": "tempest-keypair-1599380679", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f33fd39c-f843-47c5-a347-d64d8e2c8a23 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.112872 Apr 14 01:40:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 28/86] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 01:40:49 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:49 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c832a339-4408-4c36-956f-4363d98a2574 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421cb91b0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:49 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] validate_networks() for [('95555a4e-9d95-4509-a683-f61ea2dc38a1', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:40:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c832a339-4408-4c36-956f-4363d98a2574 tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.182231 Apr 14 01:40:49 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 30/87] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 01:40:49 2023] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:40:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-e53a96d7-cb66-4f6e-ad85-36a3de20b55f tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421c38550>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-e53a96d7-cb66-4f6e-ad85-36a3de20b55f tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.089099 Apr 14 01:40:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 29/88] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 01:40:49 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:49 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e7e1924e-9344-40a3-a136-380f6667539c tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] Calling method '.version_select at 0x7fd421c77e20>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e7e1924e-9344-40a3-a136-380f6667539c tempest-VolumesTestJSON-581132467 tempest-VolumesTestJSON-581132467-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.141021 Apr 14 01:40:49 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 31/89] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 01:40:49 2023] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Getting quotas for project 4833ddea1fa74866b97ef52a730605aa. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Getting quotas for user f09ab986a00f43b384cf5d517857a13d and project 4833ddea1fa74866b97ef52a730605aa. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:40:50 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:40:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.054122 Apr 14 01:40:50 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 30/90] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:40:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:40:50 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ec7500ff-10ba-49c2-9f6b-b2b8b09fc375 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:40:50 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ec7500ff-10ba-49c2-9f6b-b2b8b09fc375 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:40:50 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-ec7500ff-10ba-49c2-9f6b-b2b8b09fc375 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09ab986a00f43b384cf5d517857a13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4833ddea1fa74866b97ef52a730605aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:40:50 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ec7500ff-10ba-49c2-9f6b-b2b8b09fc375 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07" status: 200 len: 1240 microversion: 2.1 time: 0.095148 Apr 14 01:40:50 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 30/91] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:40:50 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e042a42-7cc2-4d72-b7ed-2b80339f2c85", "tag": "ed749832-992f-44d3-8316-87f59088b737"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:52 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Creating event network-changed:ed749832-992f-44d3-8316-87f59088b737 for instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 on user Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61836) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Acquired lock "compute-rpcapi-router" {{(pid=61836) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e981b210-bda2-4129-a488-5a742cd7ac54 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e981b210-bda2-4129-a488-5a742cd7ac54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e981b210-bda2-4129-a488-5a742cd7ac54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e981b210-bda2-4129-a488-5a742cd7ac54 None None] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e981b210-bda2-4129-a488-5a742cd7ac54 None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e981b210-bda2-4129-a488-5a742cd7ac54 None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:52 user devstack@n-api.service[61836]: INFO nova.compute.rpcapi [None req-e981b210-bda2-4129-a488-5a742cd7ac54 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 01:40:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e981b210-bda2-4129-a488-5a742cd7ac54 None None] Releasing lock "compute-rpcapi-router" {{(pid=61836) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 01:40:52 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e981b210-bda2-4129-a488-5a742cd7ac54 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151415 Apr 14 01:40:52 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 32/92] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:40:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da60f4f1-2474-453f-8f84-c95daf02431a", "tag": "b8356c3e-ccfb-44ae-8020-af80bcb28a43"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:54 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Creating event network-changed:b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance da60f4f1-2474-453f-8f84-c95daf02431a on user Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61837) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Acquired lock "compute-rpcapi-router" {{(pid=61837) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d661ecc3-2057-42fd-8d32-04fc5e75e8ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d661ecc3-2057-42fd-8d32-04fc5e75e8ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d661ecc3-2057-42fd-8d32-04fc5e75e8ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d661ecc3-2057-42fd-8d32-04fc5e75e8ce None None] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d661ecc3-2057-42fd-8d32-04fc5e75e8ce None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d661ecc3-2057-42fd-8d32-04fc5e75e8ce None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:54 user devstack@n-api.service[61837]: INFO nova.compute.rpcapi [None req-d661ecc3-2057-42fd-8d32-04fc5e75e8ce None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 01:40:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d661ecc3-2057-42fd-8d32-04fc5e75e8ce None None] Releasing lock "compute-rpcapi-router" {{(pid=61837) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 01:40:54 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d661ecc3-2057-42fd-8d32-04fc5e75e8ce None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158329 Apr 14 01:40:54 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 31/93] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:40:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039d0702-d115-4c25-ab88-d669c6320820", "tag": "5b6ccf71-1fe5-4324-a31c-f530be337523"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Creating event network-changed:5b6ccf71-1fe5-4324-a31c-f530be337523 for instance 039d0702-d115-4c25-ab88-d669c6320820 on user Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61835) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61835) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e5176fc7-0b3a-45fd-aa17-4f8115397bc1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e5176fc7-0b3a-45fd-aa17-4f8115397bc1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e5176fc7-0b3a-45fd-aa17-4f8115397bc1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e5176fc7-0b3a-45fd-aa17-4f8115397bc1 None None] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e5176fc7-0b3a-45fd-aa17-4f8115397bc1 None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e5176fc7-0b3a-45fd-aa17-4f8115397bc1 None None] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:56 user devstack@n-api.service[61835]: INFO nova.compute.rpcapi [None req-e5176fc7-0b3a-45fd-aa17-4f8115397bc1 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 01:40:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e5176fc7-0b3a-45fd-aa17-4f8115397bc1 None None] Releasing lock "compute-rpcapi-router" {{(pid=61835) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 01:40:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-e5176fc7-0b3a-45fd-aa17-4f8115397bc1 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131916 Apr 14 01:40:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:40:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:57 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=10 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:40:57 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d6f39ce7-f2ad-4b7e-b3d8-cd41f705e7ba tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Action: 'create', calling method: .version_select at 0x7fd421cb9cf0>, body: {"keypair": {"name": "tempest-keypair-1858701247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzSqKeU7xuvAUNkvNUpnnFYDg8L9Gwcz3w0hcuWLt8QTfKNS7hjjtyP4reBw4U2xq2tJ0MdbpLZFiWL5B1QKuYrfH5MWbhJ069nr4zUrKudohsn7krJGDoFkJv3XJBPFQ=="}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:57 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-d6f39ce7-f2ad-4b7e-b3d8-cd41f705e7ba tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Getting quotas for project d0a409270d6d4d408de33c5e71a56da9. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:40:57 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-d6f39ce7-f2ad-4b7e-b3d8-cd41f705e7ba tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Getting quotas for user bbaf843e44ff4359a15ab6d625134b07 and project d0a409270d6d4d408de33c5e71a56da9. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:40:57 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:40:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:40:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:40:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:40:57 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] Creating event network-changed:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:40:57 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116849 Apr 14 01:40:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d6f39ce7-f2ad-4b7e-b3d8-cd41f705e7ba tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.332426 Apr 14 01:40:57 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 33/95] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:40:57 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:40:57 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:40:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:00 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=12 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:00 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e042a42-7cc2-4d72-b7ed-2b80339f2c85", "name": "network-vif-plugged", "status": "completed", "tag": "ed749832-992f-44d3-8316-87f59088b737"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:00 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:00 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:00 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:00 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] Creating event network-vif-plugged:ed749832-992f-44d3-8316-87f59088b737 for instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 on user Apr 14 01:41:00 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074658 Apr 14 01:41:00 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 32/97] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:01 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1105703559", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "6569db42-40ba-4426-a76b-b3e64ecae5b0"}], "security_groups": [{"name": "tempest-securitygroup--1958050648"}], "key_name": "tempest-keypair-1858701247", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:02 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] validate_networks() for [('6569db42-40ba-4426-a76b-b3e64ecae5b0', None, None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:41:02 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=14 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e042a42-7cc2-4d72-b7ed-2b80339f2c85", "name": "network-vif-plugged", "status": "completed", "tag": "ed749832-992f-44d3-8316-87f59088b737"}, {"server_uuid": "da60f4f1-2474-453f-8f84-c95daf02431a", "name": "network-vif-plugged", "status": "completed", "tag": "b8356c3e-ccfb-44ae-8020-af80bcb28a43"}, {"server_uuid": "da60f4f1-2474-453f-8f84-c95daf02431a", "name": "network-vif-plugged", "status": "completed", "tag": "b8356c3e-ccfb-44ae-8020-af80bcb28a43"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Creating event network-vif-plugged:ed749832-992f-44d3-8316-87f59088b737 for instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 on user Apr 14 01:41:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Creating event network-vif-plugged:b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance da60f4f1-2474-453f-8f84-c95daf02431a on user Apr 14 01:41:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Creating event network-vif-plugged:b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance da60f4f1-2474-453f-8f84-c95daf02431a on user Apr 14 01:41:02 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:02 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.073805 Apr 14 01:41:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 33/98] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:02 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-156e73fb-87f8-42a0-8107-2b9581f23567 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Action: 'create', calling method: .version_select at 0x7fd421321990>, body: {"keypair": {"name": "tempest-keypair-698129803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkA+tu4xg/6rZ+pvXuvXfIBfdfqlnJ3g+nPNNirxTLXyVXJfO8nlfKhzRDd8JVflZJBNfMF2WhhlVStReA2haNPNG8030TsTlfh5bzCyX6wU3jLESQSqScW09J0bJ51Kw=="}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-plugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:02 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-156e73fb-87f8-42a0-8107-2b9581f23567 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Getting quotas for project 0d9a3bf2a3b4480a990adc9821005f7f. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] Creating event network-vif-plugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:41:02 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-156e73fb-87f8-42a0-8107-2b9581f23567 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Getting quotas for user 1a1f606719a5435dbcb6092e0708b2cb and project 0d9a3bf2a3b4480a990adc9821005f7f. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089250 Apr 14 01:41:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 34/99] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-156e73fb-87f8-42a0-8107-2b9581f23567 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.417059 Apr 14 01:41:02 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 33/100] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:41:02 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039d0702-d115-4c25-ab88-d669c6320820", "name": "network-vif-plugged", "status": "completed", "tag": "5b6ccf71-1fe5-4324-a31c-f530be337523"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] Creating event network-vif-plugged:5b6ccf71-1fe5-4324-a31c-f530be337523 for instance 039d0702-d115-4c25-ab88-d669c6320820 on user Apr 14 01:41:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029329 Apr 14 01:41:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Getting quotas for project d0a409270d6d4d408de33c5e71a56da9. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Getting quotas for user bbaf843e44ff4359a15ab6d625134b07 and project d0a409270d6d4d408de33c5e71a56da9. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:41:03 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:41:03 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.462285 Apr 14 01:41:03 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 34/102] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:41:01 2023] POST /compute/v2.1/servers => generated 404 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:41:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3fdf3dbf-4fec-48ff-8232-cb8fa1ebe7c0 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:03 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-3fdf3dbf-4fec-48ff-8232-cb8fa1ebe7c0 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:03 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-3fdf3dbf-4fec-48ff-8232-cb8fa1ebe7c0 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf843e44ff4359a15ab6d625134b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a409270d6d4d408de33c5e71a56da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3fdf3dbf-4fec-48ff-8232-cb8fa1ebe7c0 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59" status: 200 len: 1236 microversion: 2.1 time: 0.100887 Apr 14 01:41:03 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 34/103] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:41:03 2023] GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59 => generated 1236 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ea990bf6-5d92-4c01-93de-f5546fa4a329 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Action: 'create', calling method: .version_select at 0x7fd421cba0e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1007289354", "metadata": {"Type": "work"}}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ea990bf6-5d92-4c01-93de-f5546fa4a329 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Request method failure captured: Apr 14 01:41:04 user devstack@n-api.service[61835]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 01:41:04 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:41:04 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:41:04 user devstack@n-api.service[61835]: Connection: close Apr 14 01:41:04 user devstack@n-api.service[61835]: Content-Length: 122 Apr 14 01:41:04 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:41:04 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:41:04 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:41:04 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8w1_cs-E47H-QzdhREP2ijNBQpAkYqUo9Zka8lC0Jp4lrdcy1eNQ_sdR2B3_sBlZ5gRDVTu2XeElv69LIV-bcs2NaEMfVLR5WkvwJ-EZNRhzhxSpU4wCzlnQApDvVV61bA_Opq9SCfzCmOB0ltAtL1xC7_Gz_TZpmVe6sHTe3cjaY Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}] Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Tenant-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Id: 3be1fc6e829541928f1fc03a86e9acbd Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61835]: Apr 14 01:41:04 user devstack@n-api.service[61835]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1007289354", "metadata": {"Type": "work"}}} Apr 14 01:41:04 user devstack@n-api.service[61835]: method: Apr 14 01:41:04 user devstack@n-api.service[61835]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 01:41:04 user devstack@n-api.service[61835]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1007289354', 'metadata': {'Type': 'work'}}}} Apr 14 01:41:04 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise error Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ea990bf6-5d92-4c01-93de-f5546fa4a329 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:41:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ea990bf6-5d92-4c01-93de-f5546fa4a329 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.215543 Apr 14 01:41:04 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 36/104] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 01:41:04 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-9b53730b-5a7b-4e8a-bd61-83d9a6aa4496 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Action: 'create', calling method: .version_select at 0x7fd42130dfc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-504331255", "metadata": {"Type": "work"}}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:04 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-9b53730b-5a7b-4e8a-bd61-83d9a6aa4496 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Request method failure captured: Apr 14 01:41:04 user devstack@n-api.service[61836]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 01:41:04 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:41:04 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:41:04 user devstack@n-api.service[61836]: Connection: close Apr 14 01:41:04 user devstack@n-api.service[61836]: Content-Length: 119 Apr 14 01:41:04 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:41:04 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:41:04 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:41:04 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8w1_cs-E47H-QzdhREP2ijNBQpAkYqUo9Zka8lC0Jp4lrdcy1eNQ_sdR2B3_sBlZ5gRDVTu2XeElv69LIV-bcs2NaEMfVLR5WkvwJ-EZNRhzhxSpU4wCzlnQApDvVV61bA_Opq9SCfzCmOB0ltAtL1xC7_Gz_TZpmVe6sHTe3cjaY Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Project-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Project-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}] Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Tenant: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Tenant-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User-Id: 3be1fc6e829541928f1fc03a86e9acbd Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User-Name: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61836]: Apr 14 01:41:04 user devstack@n-api.service[61836]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-504331255", "metadata": {"Type": "work"}}} Apr 14 01:41:04 user devstack@n-api.service[61836]: method: Apr 14 01:41:04 user devstack@n-api.service[61836]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 01:41:04 user devstack@n-api.service[61836]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-504331255', 'metadata': {'Type': 'work'}}}} Apr 14 01:41:04 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise error Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi '0' Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-9b53730b-5a7b-4e8a-bd61-83d9a6aa4496 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:41:04 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-9b53730b-5a7b-4e8a-bd61-83d9a6aa4496 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018082 Apr 14 01:41:04 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 35/105] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 01:41:04 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3a74cc87-f3aa-4ae0-9f30-daeb08e739d0 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Action: 'create', calling method: .version_select at 0x7fd4213224d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1704311003", "metadata": {"Type": "work"}}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:04 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3a74cc87-f3aa-4ae0-9f30-daeb08e739d0 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Request method failure captured: Apr 14 01:41:04 user devstack@n-api.service[61837]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 01:41:04 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:41:04 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:41:04 user devstack@n-api.service[61837]: Connection: close Apr 14 01:41:04 user devstack@n-api.service[61837]: Content-Length: 119 Apr 14 01:41:04 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:41:04 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:41:04 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:41:04 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8w1_cs-E47H-QzdhREP2ijNBQpAkYqUo9Zka8lC0Jp4lrdcy1eNQ_sdR2B3_sBlZ5gRDVTu2XeElv69LIV-bcs2NaEMfVLR5WkvwJ-EZNRhzhxSpU4wCzlnQApDvVV61bA_Opq9SCfzCmOB0ltAtL1xC7_Gz_TZpmVe6sHTe3cjaY Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Project-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Project-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}] Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Tenant: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Tenant-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61837]: X-User: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61837]: X-User-Id: 3be1fc6e829541928f1fc03a86e9acbd Apr 14 01:41:04 user devstack@n-api.service[61837]: X-User-Name: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61837]: Apr 14 01:41:04 user devstack@n-api.service[61837]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1704311003", "metadata": {"Type": "work"}}} Apr 14 01:41:04 user devstack@n-api.service[61837]: method: Apr 14 01:41:04 user devstack@n-api.service[61837]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 01:41:04 user devstack@n-api.service[61837]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1704311003', 'metadata': {'Type': 'work'}}}} Apr 14 01:41:04 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise error Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi '' Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 01:41:04 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3a74cc87-f3aa-4ae0-9f30-daeb08e739d0 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:41:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3a74cc87-f3aa-4ae0-9f30-daeb08e739d0 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015289 Apr 14 01:41:04 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 35/106] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 01:41:04 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-fcdc952d-25f7-414c-a06c-60674a5870ab tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Calling method '.version_select at 0x7fd421cfc310>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-fcdc952d-25f7-414c-a06c-60674a5870ab tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] HTTP exception thrown: Volume tempest-invalid-545164317 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-fcdc952d-25f7-414c-a06c-60674a5870ab tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Request method failure captured: Apr 14 01:41:04 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-545164317 HTTP/1.1 Apr 14 01:41:04 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:41:04 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:41:04 user devstack@n-api.service[61835]: Connection: close Apr 14 01:41:04 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:41:04 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:41:04 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:41:04 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:41:04 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8w1_cs-E47H-QzdhREP2ijNBQpAkYqUo9Zka8lC0Jp4lrdcy1eNQ_sdR2B3_sBlZ5gRDVTu2XeElv69LIV-bcs2NaEMfVLR5WkvwJ-EZNRhzhxSpU4wCzlnQApDvVV61bA_Opq9SCfzCmOB0ltAtL1xC7_Gz_TZpmVe6sHTe3cjaY Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}] Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Tenant-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Id: 3be1fc6e829541928f1fc03a86e9acbd Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61835]: method: Apr 14 01:41:04 user devstack@n-api.service[61835]: exception: Volume tempest-invalid-545164317 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: action_args: {'id': 'tempest-invalid-545164317'} Apr 14 01:41:04 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-545164317 could not be found. (HTTP 404) (Request-ID: req-de609045-bbf5-4649-bced-789d72fb82c9) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-545164317 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-545164317 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-545164317 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-fcdc952d-25f7-414c-a06c-60674a5870ab tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Returning 404 to user: Volume tempest-invalid-545164317 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:41:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-fcdc952d-25f7-414c-a06c-60674a5870ab tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-545164317" status: 404 len: 98 microversion: 2.1 time: 0.068006 Apr 14 01:41:04 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 37/107] 10.0.0.210 () {62 vars in 1292 bytes} [Fri Apr 14 01:41:04 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-545164317 => generated 98 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b4a991f4-c984-403a-85c5-63fd7c6f4222 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003892 Apr 14 01:41:04 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 36/108] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 01:41:04 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ea3fdcfa-82ba-49bc-99c4-7e3081054e68 tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003771 Apr 14 01:41:04 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 36/109] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 01:41:04 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5ab89a83-8767-4308-8fa6-d37597c3ebaf tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Calling method '.version_select at 0x7fd421cbbd00>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-5ab89a83-8767-4308-8fa6-d37597c3ebaf tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] HTTP exception thrown: Volume 033e5de6-63a2-411d-9562-073456528479 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5ab89a83-8767-4308-8fa6-d37597c3ebaf tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Request method failure captured: Apr 14 01:41:04 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/os-volumes/033e5de6-63a2-411d-9562-073456528479 HTTP/1.1 Apr 14 01:41:04 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:41:04 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:41:04 user devstack@n-api.service[61835]: Connection: close Apr 14 01:41:04 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:41:04 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:41:04 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:41:04 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:41:04 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8w1_cs-E47H-QzdhREP2ijNBQpAkYqUo9Zka8lC0Jp4lrdcy1eNQ_sdR2B3_sBlZ5gRDVTu2XeElv69LIV-bcs2NaEMfVLR5WkvwJ-EZNRhzhxSpU4wCzlnQApDvVV61bA_Opq9SCfzCmOB0ltAtL1xC7_Gz_TZpmVe6sHTe3cjaY Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}] Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Tenant-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Id: 3be1fc6e829541928f1fc03a86e9acbd Apr 14 01:41:04 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61835]: method: Apr 14 01:41:04 user devstack@n-api.service[61835]: exception: Volume 033e5de6-63a2-411d-9562-073456528479 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: action_args: {'id': '033e5de6-63a2-411d-9562-073456528479'} Apr 14 01:41:04 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 033e5de6-63a2-411d-9562-073456528479 could not be found. (HTTP 404) (Request-ID: req-0d14de13-2a40-4c93-a68c-dc3a04b8fc1d) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 033e5de6-63a2-411d-9562-073456528479 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 033e5de6-63a2-411d-9562-073456528479 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 033e5de6-63a2-411d-9562-073456528479 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5ab89a83-8767-4308-8fa6-d37597c3ebaf tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Returning 404 to user: Volume 033e5de6-63a2-411d-9562-073456528479 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:41:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5ab89a83-8767-4308-8fa6-d37597c3ebaf tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/033e5de6-63a2-411d-9562-073456528479" status: 404 len: 109 microversion: 2.1 time: 0.065666 Apr 14 01:41:04 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 38/110] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 01:41:04 2023] DELETE /compute/v2.1/os-volumes/033e5de6-63a2-411d-9562-073456528479 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-bc2b7728-87c0-4518-bde4-2069c092f0fa tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Calling method '.version_select at 0x7fd421d52680>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:04 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-bc2b7728-87c0-4518-bde4-2069c092f0fa tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] HTTP exception thrown: Volume 6acc01f3-4378-468a-b181-89d0763470c0 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-bc2b7728-87c0-4518-bde4-2069c092f0fa tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Request method failure captured: Apr 14 01:41:04 user devstack@n-api.service[61836]: request: GET /compute/v2.1/os-volumes/6acc01f3-4378-468a-b181-89d0763470c0 HTTP/1.1 Apr 14 01:41:04 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:41:04 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:41:04 user devstack@n-api.service[61836]: Connection: close Apr 14 01:41:04 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:41:04 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:41:04 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:41:04 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:41:04 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8w1_cs-E47H-QzdhREP2ijNBQpAkYqUo9Zka8lC0Jp4lrdcy1eNQ_sdR2B3_sBlZ5gRDVTu2XeElv69LIV-bcs2NaEMfVLR5WkvwJ-EZNRhzhxSpU4wCzlnQApDvVV61bA_Opq9SCfzCmOB0ltAtL1xC7_Gz_TZpmVe6sHTe3cjaY Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Project-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Project-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8bf9d74f37514192ab85ec8e3425a174"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8bf9d74f37514192ab85ec8e3425a174"}]}] Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Tenant: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Tenant-Id: 8bf9d74f37514192ab85ec8e3425a174 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-VolumesNegativeTest-303309152 Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User-Id: 3be1fc6e829541928f1fc03a86e9acbd Apr 14 01:41:04 user devstack@n-api.service[61836]: X-User-Name: tempest-VolumesNegativeTest-303309152-project-member Apr 14 01:41:04 user devstack@n-api.service[61836]: method: Apr 14 01:41:04 user devstack@n-api.service[61836]: exception: Volume 6acc01f3-4378-468a-b181-89d0763470c0 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61836]: action_args: {'id': '6acc01f3-4378-468a-b181-89d0763470c0'} Apr 14 01:41:04 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6acc01f3-4378-468a-b181-89d0763470c0 could not be found. (HTTP 404) (Request-ID: req-3c7203c0-e434-4047-a2c3-1c9befa01ad9) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6acc01f3-4378-468a-b181-89d0763470c0 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6acc01f3-4378-468a-b181-89d0763470c0 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6acc01f3-4378-468a-b181-89d0763470c0 could not be found. Apr 14 01:41:04 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:41:04 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-bc2b7728-87c0-4518-bde4-2069c092f0fa tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] Returning 404 to user: Volume 6acc01f3-4378-468a-b181-89d0763470c0 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:41:04 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-bc2b7728-87c0-4518-bde4-2069c092f0fa tempest-VolumesNegativeTest-303309152 tempest-VolumesNegativeTest-303309152-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6acc01f3-4378-468a-b181-89d0763470c0" status: 404 len: 109 microversion: 2.1 time: 0.041571 Apr 14 01:41:04 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 37/111] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:41:04 2023] GET /compute/v2.1/os-volumes/6acc01f3-4378-468a-b181-89d0763470c0 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-plugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:04 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] Creating event network-vif-plugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:41:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065014 Apr 14 01:41:04 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 37/112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039d0702-d115-4c25-ab88-d669c6320820", "name": "network-vif-plugged", "status": "completed", "tag": "5b6ccf71-1fe5-4324-a31c-f530be337523"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] Creating event network-vif-plugged:5b6ccf71-1fe5-4324-a31c-f530be337523 for instance 039d0702-d115-4c25-ab88-d669c6320820 on user Apr 14 01:41:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039141 Apr 14 01:41:04 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 39/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e92069c6-1da5-43b6-920d-31f788186288 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Action: 'create', calling method: .version_select at 0x7fd42130cca0>, body: {"keypair": {"name": "tempest-keypair-658101980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg=="}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:05 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-e92069c6-1da5-43b6-920d-31f788186288 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Getting quotas for project 58f0122cc9864fcea660891e2826ca7b. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:05 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-e92069c6-1da5-43b6-920d-31f788186288 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Getting quotas for user 2bada5cdb7704f6b956eb48b3729388d and project 58f0122cc9864fcea660891e2826ca7b. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e92069c6-1da5-43b6-920d-31f788186288 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.132841 Apr 14 01:41:05 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 38/114] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 01:41:05 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 01:41:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1295717929", "imageRef": "8ac72bf7-6709-4b09-92e0-a06bd5d54f4d", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "e70b6880-528f-41d8-b154-89eabc02efdb"}], "security_groups": [{"name": "tempest-securitygroup--712222772"}], "key_name": "tempest-keypair-698129803", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:06 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] validate_networks() for [('e70b6880-528f-41d8-b154-89eabc02efdb', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Getting quotas for project 0d9a3bf2a3b4480a990adc9821005f7f. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Getting quotas for user 1a1f606719a5435dbcb6092e0708b2cb and project 0d9a3bf2a3b4480a990adc9821005f7f. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:41:07 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8ac72bf7-6709-4b09-92e0-a06bd5d54f4d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:41:07 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.439728 Apr 14 01:41:07 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 38/115] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:41:05 2023] POST /compute/v2.1/servers => generated 403 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:41:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-8ba82212-9891-44f8-b77d-27651ba8e6f2 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:07 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-8ba82212-9891-44f8-b77d-27651ba8e6f2 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:07 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:07 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-8ba82212-9891-44f8-b77d-27651ba8e6f2 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1f606719a5435dbcb6092e0708b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9a3bf2a3b4480a990adc9821005f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-8ba82212-9891-44f8-b77d-27651ba8e6f2 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f" status: 200 len: 1239 microversion: 2.1 time: 0.186939 Apr 14 01:41:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 40/116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:41:07 2023] GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f => generated 1239 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:41:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68784e7-578c-4a12-87d4-f35fbc5a1d59", "tag": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] Creating event network-changed:08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 on user Apr 14 01:41:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070700 Apr 14 01:41:08 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:09 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1373277645", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23"}], "security_groups": [{"name": "tempest-securitygroup--601403347"}], "key_name": "tempest-keypair-658101980", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:09 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] validate_networks() for [('c7acaa49-fce0-41b5-8dd6-d5ef02e27e23', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Getting quotas for project 58f0122cc9864fcea660891e2826ca7b. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Getting quotas for user 2bada5cdb7704f6b956eb48b3729388d and project 58f0122cc9864fcea660891e2826ca7b. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:41:10 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:41:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 1.193785 Apr 14 01:41:10 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 39/118] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 01:41:09 2023] POST /compute/v2.1/servers => generated 403 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 01:41:10 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-730df84a-0c58-4bc0-b9d3-6412060c2153 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:10 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-730df84a-0c58-4bc0-b9d3-6412060c2153 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:10 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-730df84a-0c58-4bc0-b9d3-6412060c2153 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:10 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-730df84a-0c58-4bc0-b9d3-6412060c2153 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:10 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-730df84a-0c58-4bc0-b9d3-6412060c2153 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-730df84a-0c58-4bc0-b9d3-6412060c2153 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e" status: 200 len: 1320 microversion: 2.49 time: 0.178316 Apr 14 01:41:10 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 41/119] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:41:10 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:41:12 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-2cb4192e-ce06-4c4f-b993-92eddc1bd99b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Action: 'create', calling method: .version_select at 0x7fd42130d5a0>, body: {"keypair": {"name": "tempest-keypair-1595267406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPNiUI2ug6LQUiapieczdsy9Wqi1WC3qcruFFPEMTuuD+5FKNmRUw7VMsnHH30l96OHFwUCmZQiDrlxZsDi3HAwnteFmFsj2Cvd/o8xLG4tOF7+RBcte95gdr83Q6b27w=="}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:12 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-2cb4192e-ce06-4c4f-b993-92eddc1bd99b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Getting quotas for project 3e707623638044e983b557119edd7673. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:12 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-2cb4192e-ce06-4c4f-b993-92eddc1bd99b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Getting quotas for user f6e19e75aa9d4cda971c8d2449e85290 and project 3e707623638044e983b557119edd7673. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:12 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-2cb4192e-ce06-4c4f-b993-92eddc1bd99b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080974 Apr 14 01:41:12 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 40/120] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:41:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:13 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68784e7-578c-4a12-87d4-f35fbc5a1d59", "name": "network-vif-plugged", "status": "completed", "tag": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:13 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=13 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:13 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=17 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:13 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] Creating event network-vif-plugged:08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 on user Apr 14 01:41:13 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162122 Apr 14 01:41:13 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:14 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d10278-cf24-4fde-86eb-664ba86cbd8f", "tag": "ed3a6f44-e7a4-41b0-9769-71beee125cb1"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:14 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] Creating event network-changed:ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance f1d10278-cf24-4fde-86eb-664ba86cbd8f on user Apr 14 01:41:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048751 Apr 14 01:41:14 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 42/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:15 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68784e7-578c-4a12-87d4-f35fbc5a1d59", "name": "network-vif-plugged", "status": "completed", "tag": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] Creating event network-vif-plugged:08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 on user Apr 14 01:41:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153879 Apr 14 01:41:15 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 41/123] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1080614213", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a"}], "security_groups": [{"name": "tempest-securitygroup--1066152726"}], "key_name": "tempest-keypair-1595267406", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:15 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] validate_networks() for [('335d6a15-36dc-4fbc-ae2a-08b44984eb3a', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Getting quotas for project 3e707623638044e983b557119edd7673. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Getting quotas for user f6e19e75aa9d4cda971c8d2449e85290 and project 3e707623638044e983b557119edd7673. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:41:16 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:41:16 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.149633 Apr 14 01:41:16 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 41/124] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:41:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:41:16 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a884a220-5421-4a41-9609-4ec50f0cd76b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:16 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a884a220-5421-4a41-9609-4ec50f0cd76b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:16 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-a884a220-5421-4a41-9609-4ec50f0cd76b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e19e75aa9d4cda971c8d2449e85290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e707623638044e983b557119edd7673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:16 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a884a220-5421-4a41-9609-4ec50f0cd76b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" status: 200 len: 1226 microversion: 2.1 time: 0.123561 Apr 14 01:41:16 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 43/125] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:41:16 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:41:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "tag": "6762a294-eced-41bd-87c0-ac112e954d3a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] Creating event network-changed:6762a294-eced-41bd-87c0-ac112e954d3a for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:41:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131652 Apr 14 01:41:17 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d10278-cf24-4fde-86eb-664ba86cbd8f", "name": "network-vif-plugged", "status": "completed", "tag": "ed3a6f44-e7a4-41b0-9769-71beee125cb1"}, {"server_uuid": "f1d10278-cf24-4fde-86eb-664ba86cbd8f", "name": "network-vif-plugged", "status": "completed", "tag": "ed3a6f44-e7a4-41b0-9769-71beee125cb1"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Creating event network-vif-plugged:ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance f1d10278-cf24-4fde-86eb-664ba86cbd8f on user Apr 14 01:41:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Creating event network-vif-plugged:ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance f1d10278-cf24-4fde-86eb-664ba86cbd8f on user Apr 14 01:41:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085330 Apr 14 01:41:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 42/127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-plugged", "status": "completed", "tag": "6762a294-eced-41bd-87c0-ac112e954d3a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] Creating event network-vif-plugged:6762a294-eced-41bd-87c0-ac112e954d3a for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:41:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083688 Apr 14 01:41:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 44/128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:21 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c", "tag": "72f288aa-49e2-407b-9e41-47c8fd81286f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] Creating event network-changed:72f288aa-49e2-407b-9e41-47c8fd81286f for instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c on user Apr 14 01:41:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055844 Apr 14 01:41:21 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:22 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-plugged", "status": "completed", "tag": "6762a294-eced-41bd-87c0-ac112e954d3a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] Creating event network-vif-plugged:6762a294-eced-41bd-87c0-ac112e954d3a for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:41:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042752 Apr 14 01:41:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 43/130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:24 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c", "name": "network-vif-plugged", "status": "completed", "tag": "72f288aa-49e2-407b-9e41-47c8fd81286f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:24 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] Creating event network-vif-plugged:72f288aa-49e2-407b-9e41-47c8fd81286f for instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c on user Apr 14 01:41:24 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036480 Apr 14 01:41:24 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 45/131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:26 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=18 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c", "name": "network-vif-plugged", "status": "completed", "tag": "72f288aa-49e2-407b-9e41-47c8fd81286f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] Creating event network-vif-plugged:72f288aa-49e2-407b-9e41-47c8fd81286f for instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c on user Apr 14 01:41:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Apr 14 01:41:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 44/132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=24 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:33 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:33 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-5ba76788-327f-4e84-ac05-b89a42bd5d63 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a" status: 200 len: 1494 microversion: 2.1 time: 1.178813 Apr 14 01:41:33 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:41:31 2023] GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a => generated 1494 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=21 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:33 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:33 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d2874add-2871-4ba4-b3d1-e010838b0ddb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85" status: 200 len: 1691 microversion: 2.87 time: 0.715764 Apr 14 01:41:33 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 46/134] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:41:33 2023] GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85 => generated 1691 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=13 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:36 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fae797718f548fba18e7bc01829f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fbd5c190254145815a39079b57881c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-45e98179-1ed7-4244-aa6f-234601c8f38f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820" status: 200 len: 1488 microversion: 2.1 time: 0.413425 Apr 14 01:41:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 45/135] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:41:36 2023] GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 => generated 1488 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:41:40 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:40 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:40 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09ab986a00f43b384cf5d517857a13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4833ddea1fa74866b97ef52a730605aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-a5021808-cc7a-4655-8b77-42c72bdb19b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07" status: 200 len: 1553 microversion: 2.1 time: 0.179317 Apr 14 01:41:40 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:41:40 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:41:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f1acd940-9ee0-4d1e-828f-a9e6ad02fce5 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Action: 'create', calling method: .version_select at 0x7fd421cbad40>, body: {"keypair": {"name": "tempest-keypair-1529995714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:41 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-f1acd940-9ee0-4d1e-828f-a9e6ad02fce5 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Getting quotas for project 113733a7b1f9424bb5243107472b01c6. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:41 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-f1acd940-9ee0-4d1e-828f-a9e6ad02fce5 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Getting quotas for user 692d1dd6aa73472a9c63049910360a0b and project 113733a7b1f9424bb5243107472b01c6. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f1acd940-9ee0-4d1e-828f-a9e6ad02fce5 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.054447 Apr 14 01:41:41 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 47/137] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 01:41:41 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 01:41:43 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1230095561", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "92b9d247-3013-4a97-9ca0-41643807ce1e"}, {"port": "eee87019-7923-4e16-8e15-f2a1010616e3", "tag": "port-1"}, {"port": "fd852601-98a3-4811-8bf5-120906e84646", "tag": "port-2"}, {"uuid": "08a79a3b-5c3d-4923-b568-4655661083a4", "tag": "net-1"}, {"uuid": "08a79a3b-5c3d-4923-b568-4655661083a4"}, {"uuid": "9169c3c6-6243-44ce-8070-5991e81046ce", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9169c3c6-6243-44ce-8070-5991e81046ce", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5e9b1e2c-15a4-481a-a713-fa24dca0918e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "953520b1-6ecb-41ad-8793-851901048f6d", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "da07fe19-d0bc-4451-a0c5-29df607f9b02", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--840748994"}], "key_name": "tempest-keypair-1529995714", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:43 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] validate_networks() for [('92b9d247-3013-4a97-9ca0-41643807ce1e', None, None, None, None, None), (None, None, 'eee87019-7923-4e16-8e15-f2a1010616e3', None, None, None), (None, None, 'fd852601-98a3-4811-8bf5-120906e84646', None, None, None), ('08a79a3b-5c3d-4923-b568-4655661083a4', None, None, None, None, None), ('08a79a3b-5c3d-4923-b568-4655661083a4', None, None, None, None, None), ('9169c3c6-6243-44ce-8070-5991e81046ce', '10.2.2.100', None, None, None, None), ('9169c3c6-6243-44ce-8070-5991e81046ce', '10.2.2.200', None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Getting quotas for project 113733a7b1f9424bb5243107472b01c6. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Getting quotas for user 692d1dd6aa73472a9c63049910360a0b and project 113733a7b1f9424bb5243107472b01c6. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:41:46 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5e9b1e2c-15a4-481a-a713-fa24dca0918e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='953520b1-6ecb-41ad-8793-851901048f6d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da07fe19-d0bc-4451-a0c5-29df607f9b02',volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:41:46 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 3.449511 Apr 14 01:41:46 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 46/138] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 01:41:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 3451 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 01:41:46 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f9495a51-c729-4228-bcf8-8cc9dac2f041 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:46 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f9495a51-c729-4228-bcf8-8cc9dac2f041 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:46 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:46 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-f9495a51-c729-4228-bcf8-8cc9dac2f041 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:46 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-f9495a51-c729-4228-bcf8-8cc9dac2f041 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:46 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-f9495a51-c729-4228-bcf8-8cc9dac2f041 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f9495a51-c729-4228-bcf8-8cc9dac2f041 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" status: 200 len: 1280 microversion: 2.32 time: 0.074433 Apr 14 01:41:46 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 46/139] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:41:46 2023] GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:41:50 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=5 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:50 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-888539893", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:50 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:50 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] validate_networks() for [('d2f0bf5d-7422-436e-82b2-95cfe8eb77bd', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Getting quotas for project cdb176ac656c47b38e736fc629fc46e0. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Getting quotas for user 8b18b911fcf847efbf4f814f3b687279 and project cdb176ac656c47b38e736fc629fc46e0. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:41:51 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:41:51 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.060614 Apr 14 01:41:51 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 48/140] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:41:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:41:51 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ac8cf8e2-d989-45ec-b56e-c946fe9fc235 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:51 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ac8cf8e2-d989-45ec-b56e-c946fe9fc235 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:51 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-ac8cf8e2-d989-45ec-b56e-c946fe9fc235 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b18b911fcf847efbf4f814f3b687279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb176ac656c47b38e736fc629fc46e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ac8cf8e2-d989-45ec-b56e-c946fe9fc235 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb" status: 200 len: 1207 microversion: 2.1 time: 0.083313 Apr 14 01:41:51 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:41:51 2023] GET /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb => generated 1207 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=19 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:53 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf843e44ff4359a15ab6d625134b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a409270d6d4d408de33c5e71a56da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:53 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-c0178d8e-0d97-4cb3-a08c-7d5c7bae05d5 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59" status: 200 len: 1546 microversion: 2.1 time: 0.290451 Apr 14 01:41:53 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:41:53 2023] GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59 => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:41:53 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "tag": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:53 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] Creating event network-changed:3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:41:53 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076705 Apr 14 01:41:53 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 49/143] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:55 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9397a9e2-b5e9-47e7-b25e-5c40379a60eb", "tag": "084feebd-4d90-4eab-b8ec-346c32858b42"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] Creating event network-changed:084feebd-4d90-4eab-b8ec-346c32858b42 for instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb on user Apr 14 01:41:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035491 Apr 14 01:41:55 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 48/144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:55 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "tag": "eee87019-7923-4e16-8e15-f2a1010616e3"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:55 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] Creating event network-changed:eee87019-7923-4e16-8e15-f2a1010616e3 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:41:55 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040921 Apr 14 01:41:55 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:57 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9397a9e2-b5e9-47e7-b25e-5c40379a60eb", "name": "network-vif-plugged", "status": "completed", "tag": "084feebd-4d90-4eab-b8ec-346c32858b42"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:57 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] Creating event network-vif-plugged:084feebd-4d90-4eab-b8ec-346c32858b42 for instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb on user Apr 14 01:41:57 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036117 Apr 14 01:41:57 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 50/146] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:57 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1f606719a5435dbcb6092e0708b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9a3bf2a3b4480a990adc9821005f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:41:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-857f4c9d-7f9d-4b1b-9541-96d4a1d993c4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f" status: 200 len: 1549 microversion: 2.1 time: 0.209749 Apr 14 01:41:57 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:41:57 2023] GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f => generated 1549 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:41:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:41:58 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "tag": "fd852601-98a3-4811-8bf5-120906e84646"}, {"name": "network-changed", "server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "tag": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c"}, {"name": "network-changed", "server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "tag": "2b26233c-8774-42ae-9f2f-8794c8e364a1"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Creating event network-changed:fd852601-98a3-4811-8bf5-120906e84646 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:41:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Creating event network-changed:d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:41:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Creating event network-changed:2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:41:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.040017 Apr 14 01:41:58 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:58 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:41:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9397a9e2-b5e9-47e7-b25e-5c40379a60eb", "name": "network-vif-plugged", "status": "completed", "tag": "084feebd-4d90-4eab-b8ec-346c32858b42"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:41:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:41:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:41:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:41:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] Creating event network-vif-plugged:084feebd-4d90-4eab-b8ec-346c32858b42 for instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb on user Apr 14 01:41:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044898 Apr 14 01:41:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 51/149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:41:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "tag": "592ca281-1142-433c-996f-54b6bdce948b"}, {"name": "network-changed", "server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "tag": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Creating event network-changed:592ca281-1142-433c-996f-54b6bdce948b for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Creating event network-changed:933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075764 Apr 14 01:42:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:00 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:00 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:01 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:01 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:01 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:01 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-65cd6609-c425-4347-9d35-6308cc2b6948 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e" status: 200 len: 1627 microversion: 2.49 time: 0.317062 Apr 14 01:42:01 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 50/151] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:42:00 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e => generated 1627 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:42:02 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:02 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=10 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-303b5f8c-de66-485d-9908-fe82610ee46b tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Action: 'create', calling method: .version_select at 0x7fd42135c040>, body: {"keypair": {"name": "tempest-TestShelveInstance-711764184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8oQGYR+FY0LiM859XrQ9H3YlzTk6smIp49cfjoqSvxd/aONSV1r/k9gt1d5Db4fmA7gXaDRWLZ6VOsvQ07UleStWf5lgaLtfeieMukM+I8PpxvvoXTX8ZP8xMyS5I5RA=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:02 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-303b5f8c-de66-485d-9908-fe82610ee46b tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Getting quotas for project ef081a56d11d4b4d82ba5fe6572f3b95. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:42:02 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-303b5f8c-de66-485d-9908-fe82610ee46b tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Getting quotas for user 447da297b18f4e7f86fa94cd4d5d7918 and project ef081a56d11d4b4d82ba5fe6572f3b95. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:42:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-303b5f8c-de66-485d-9908-fe82610ee46b tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.306301 Apr 14 01:42:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 52/152] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:42:02 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:06 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=18 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:07 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e19e75aa9d4cda971c8d2449e85290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e707623638044e983b557119edd7673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-9f34d5c6-894b-42d8-837a-6c2593e962c6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" status: 200 len: 1527 microversion: 2.1 time: 0.180409 Apr 14 01:42:07 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 51/153] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:42:06 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c => generated 1527 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 01:42:07 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1018221636", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-711764184", "security_groups": [{"name": "tempest-secgroup-smoke-536464592"}], "networks": [{"uuid": "4f7f7e24-860c-47ce-b635-be72e8fe2913"}], "block_device_mapping_v2": [{"uuid": "f78596d7-c339-491a-a0d2-470a1c158a53", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] validate_networks() for [('4f7f7e24-860c-47ce-b635-be72e8fe2913', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Getting quotas for project ef081a56d11d4b4d82ba5fe6572f3b95. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Getting quotas for user 447da297b18f4e7f86fa94cd4d5d7918 and project ef081a56d11d4b4d82ba5fe6572f3b95. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:42:08 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f78596d7-c339-491a-a0d2-470a1c158a53',volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:42:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.740692 Apr 14 01:42:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 51/154] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:42:07 2023] POST /compute/v2.1/servers => generated 403 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:42:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-dd7aa1c8-1940-4fd8-957c-2db1b7ddd1c9 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-dd7aa1c8-1940-4fd8-957c-2db1b7ddd1c9 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:08 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-dd7aa1c8-1940-4fd8-957c-2db1b7ddd1c9 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447da297b18f4e7f86fa94cd4d5d7918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef081a56d11d4b4d82ba5fe6572f3b95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-dd7aa1c8-1940-4fd8-957c-2db1b7ddd1c9 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 200 len: 1083 microversion: 2.1 time: 0.070204 Apr 14 01:42:08 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 53/155] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:42:08 2023] GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 1083 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:42:11 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] Creating event network-changed:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:42:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030921 Apr 14 01:42:11 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 52/156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:13 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:13 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] Creating event network-vif-plugged:3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:13 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047730 Apr 14 01:42:13 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 52/157] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:13 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:13 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "eee87019-7923-4e16-8e15-f2a1010616e3"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] Creating event network-vif-plugged:eee87019-7923-4e16-8e15-f2a1010616e3 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033224 Apr 14 01:42:13 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 54/158] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:14 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "2b26233c-8774-42ae-9f2f-8794c8e364a1"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] Creating event network-vif-plugged:2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048966 Apr 14 01:42:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 53/159] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "fd852601-98a3-4811-8bf5-120906e84646"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "fd852601-98a3-4811-8bf5-120906e84646"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Creating event network-vif-plugged:3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Creating event network-vif-plugged:fd852601-98a3-4811-8bf5-120906e84646 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Creating event network-vif-plugged:fd852601-98a3-4811-8bf5-120906e84646 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Creating event network-vif-plugged:d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Creating event network-vif-plugged:d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.039563 Apr 14 01:42:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 53/160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:15 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:15 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "eee87019-7923-4e16-8e15-f2a1010616e3"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:15 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] Creating event network-vif-plugged:eee87019-7923-4e16-8e15-f2a1010616e3 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:15 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045204 Apr 14 01:42:15 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 55/161] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:16 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "2b26233c-8774-42ae-9f2f-8794c8e364a1"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "592ca281-1142-433c-996f-54b6bdce948b"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "592ca281-1142-433c-996f-54b6bdce948b"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Creating event network-vif-plugged:2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Creating event network-vif-plugged:592ca281-1142-433c-996f-54b6bdce948b for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Creating event network-vif-plugged:592ca281-1142-433c-996f-54b6bdce948b for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Creating event network-vif-plugged:933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Creating event network-vif-plugged:933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:42:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.031813 Apr 14 01:42:16 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 54/162] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:16 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1371662919", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:19 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] validate_networks() for None {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Getting quotas for project 4910c626438f42e9a5db828ae4dae86c. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Getting quotas for user 8ebae9b1685f46aea0064cf83813e4d8 and project 4910c626438f42e9a5db828ae4dae86c. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:42:20 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:42:20 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.874199 Apr 14 01:42:20 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 54/163] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:42:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:42:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5a323cb4-e96c-4d1a-abbd-87c818d78988 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:20 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5a323cb4-e96c-4d1a-abbd-87c818d78988 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:20 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-5a323cb4-e96c-4d1a-abbd-87c818d78988 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebae9b1685f46aea0064cf83813e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4910c626438f42e9a5db828ae4dae86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5a323cb4-e96c-4d1a-abbd-87c818d78988 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1" status: 200 len: 1209 microversion: 2.1 time: 0.098448 Apr 14 01:42:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 56/164] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:42:20 2023] GET /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1 => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:42:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-plugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] Creating event network-vif-plugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:42:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065207 Apr 14 01:42:20 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 55/165] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:22 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-plugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] Creating event network-vif-plugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:42:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044528 Apr 14 01:42:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 55/166] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:23 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "160b86fd-8405-42f5-90b2-8069917e4df1", "tag": "54ba4ed4-462e-4ba6-896d-748b91cfa41e"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:23 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] Creating event network-changed:54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance 160b86fd-8405-42f5-90b2-8069917e4df1 on user Apr 14 01:42:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036639 Apr 14 01:42:23 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 57/167] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:25 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160b86fd-8405-42f5-90b2-8069917e4df1", "name": "network-vif-plugged", "status": "completed", "tag": "54ba4ed4-462e-4ba6-896d-748b91cfa41e"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:25 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] Creating event network-vif-plugged:54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance 160b86fd-8405-42f5-90b2-8069917e4df1 on user Apr 14 01:42:25 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 Apr 14 01:42:25 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 56/168] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160b86fd-8405-42f5-90b2-8069917e4df1", "name": "network-vif-plugged", "status": "completed", "tag": "54ba4ed4-462e-4ba6-896d-748b91cfa41e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:27 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=27 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] Creating event network-vif-plugged:54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance 160b86fd-8405-42f5-90b2-8069917e4df1 on user Apr 14 01:42:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031648 Apr 14 01:42:27 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 56/169] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:33 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:33 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1686309236", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "93155729-11d3-4eff-bbd2-8860a881e233"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:33 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] validate_networks() for [('93155729-11d3-4eff-bbd2-8860a881e233', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:42:33 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:33 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-380041754"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:33 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Getting quotas for project 907f632263e04bf2a6c8ff1bae77a5c7. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Getting quotas for user 236828e284154097a25f59eaedf47c29 and project 907f632263e04bf2a6c8ff1bae77a5c7. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:42:34 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:42:34 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.782189 Apr 14 01:42:34 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 58/170] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:42:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:42:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:34 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-cfe5e5fd-dfdb-4002-81f0-61b3bb4383e8 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:34 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-cfe5e5fd-dfdb-4002-81f0-61b3bb4383e8 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:34 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-cfe5e5fd-dfdb-4002-81f0-61b3bb4383e8 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-cfe5e5fd-dfdb-4002-81f0-61b3bb4383e8 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6" status: 200 len: 1211 microversion: 2.1 time: 0.121531 Apr 14 01:42:34 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:42:34 2023] GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 => generated 1211 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:42:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/action" status: 202 len: 52 microversion: 2.87 time: 1.222383 Apr 14 01:42:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 57/172] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 01:42:33 2023] POST /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/action => generated 52 bytes in 1225 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 01:42:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:36 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:37 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:37 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:37 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:37 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-63d35382-0a46-4aaa-a44a-8b9158f5b148 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" status: 200 len: 2818 microversion: 2.32 time: 0.366211 Apr 14 01:42:37 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 59/173] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:42:36 2023] GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => generated 2818 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:42:37 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfd39c9-8535-40d0-863d-c30fc98103e6", "tag": "2baffc32-6ecf-4d00-b556-31dc99113a1a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] Creating event network-changed:2baffc32-6ecf-4d00-b556-31dc99113a1a for instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 on user Apr 14 01:42:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040496 Apr 14 01:42:37 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 58/174] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91568232-871f-4584-be95-10c420297fe0"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=14 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:38 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:39 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "POST /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641691 Apr 14 01:42:39 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 58/175] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:42:38 2023] POST /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:40 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfd39c9-8535-40d0-863d-c30fc98103e6", "name": "network-vif-plugged", "status": "completed", "tag": "2baffc32-6ecf-4d00-b556-31dc99113a1a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] Creating event network-vif-plugged:2baffc32-6ecf-4d00-b556-31dc99113a1a for instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 on user Apr 14 01:42:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237864 Apr 14 01:42:40 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 60/176] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:40 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-42bebe27-90e8-480b-8551-e6abed233480 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:40 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-42bebe27-90e8-480b-8551-e6abed233480 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42bebe27-90e8-480b-8551-e6abed233480 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42bebe27-90e8-480b-8551-e6abed233480 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42bebe27-90e8-480b-8551-e6abed233480 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42bebe27-90e8-480b-8551-e6abed233480 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42bebe27-90e8-480b-8551-e6abed233480 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42bebe27-90e8-480b-8551-e6abed233480 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-42bebe27-90e8-480b-8551-e6abed233480 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.557616 Apr 14 01:42:41 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 59/177] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:42:40 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-interface => generated 282 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:41 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-03e3eac9-97c3-4e6f-bc02-28fc61e07382 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85" status: 200 len: 1691 microversion: 2.87 time: 0.292535 Apr 14 01:42:41 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 59/178] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:42:41 2023] GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85 => generated 1691 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:42:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:41 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:41 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b18b911fcf847efbf4f814f3b687279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb176ac656c47b38e736fc629fc46e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-335ede40-4bef-4139-9e94-ef49377b0efd tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb" status: 200 len: 1486 microversion: 2.1 time: 0.285913 Apr 14 01:42:42 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 61/179] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:42:41 2023] GET /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb => generated 1486 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:42:42 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfd39c9-8535-40d0-863d-c30fc98103e6", "name": "network-vif-plugged", "status": "completed", "tag": "2baffc32-6ecf-4d00-b556-31dc99113a1a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] Creating event network-vif-plugged:2baffc32-6ecf-4d00-b556-31dc99113a1a for instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 on user Apr 14 01:42:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031330 Apr 14 01:42:42 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 60/180] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:42 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] Creating event network-changed:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:42:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033971 Apr 14 01:42:42 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 60/181] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:42 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-828686351"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:42 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/action" status: 202 len: 0 microversion: 2.1 time: 1.076826 Apr 14 01:42:43 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 62/182] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:42:42 2023] POST /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/action => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 01:42:43 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e20c04d0-f002-45ca-9266-4430845c6c0b tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '.version_select at 0x7fd4213f6830>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:43 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e20c04d0-f002-45ca-9266-4430845c6c0b tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/images/0abe5ca9-f8b7-4782-9d51-b632ce789e86" status: 200 len: 1608 microversion: 2.1 time: 0.075042 Apr 14 01:42:43 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 61/183] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 01:42:43 2023] GET /compute/v2.1/images/0abe5ca9-f8b7-4782-9d51-b632ce789e86 => generated 1608 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:42:47 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:47 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:47 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:42:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820" status: 204 len: 0 microversion: 2.1 time: 0.139264 Apr 14 01:42:47 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 61/184] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:42:47 2023] DELETE /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:47 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fae797718f548fba18e7bc01829f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fbd5c190254145815a39079b57881c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:47 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-4f8cf54b-7973-40d7-8897-7c0bbc115e69 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820" status: 200 len: 1540 microversion: 2.1 time: 0.189116 Apr 14 01:42:47 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 63/185] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:42:47 2023] GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 => generated 1540 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:42:48 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039d0702-d115-4c25-ab88-d669c6320820", "name": "network-vif-unplugged", "status": "completed", "tag": "5b6ccf71-1fe5-4324-a31c-f530be337523"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] Creating event network-vif-unplugged:5b6ccf71-1fe5-4324-a31c-f530be337523 for instance 039d0702-d115-4c25-ab88-d669c6320820 on user Apr 14 01:42:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050034 Apr 14 01:42:48 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 62/186] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:49 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-fd9405f6-e737-47e2-86df-5c9ab7fc15ba req-f5556ec9-5203-4bc6-b314-c49a6f6a54f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039d0702-d115-4c25-ab88-d669c6320820", "name": "network-vif-deleted", "tag": "5b6ccf71-1fe5-4324-a31c-f530be337523"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-fd9405f6-e737-47e2-86df-5c9ab7fc15ba req-f5556ec9-5203-4bc6-b314-c49a6f6a54f2 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-fd9405f6-e737-47e2-86df-5c9ab7fc15ba req-f5556ec9-5203-4bc6-b314-c49a6f6a54f2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-fd9405f6-e737-47e2-86df-5c9ab7fc15ba req-f5556ec9-5203-4bc6-b314-c49a6f6a54f2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-fd9405f6-e737-47e2-86df-5c9ab7fc15ba req-f5556ec9-5203-4bc6-b314-c49a6f6a54f2 service nova] Creating event network-vif-deleted:5b6ccf71-1fe5-4324-a31c-f530be337523 for instance 039d0702-d115-4c25-ab88-d669c6320820 on user Apr 14 01:42:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-fd9405f6-e737-47e2-86df-5c9ab7fc15ba req-f5556ec9-5203-4bc6-b314-c49a6f6a54f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040059 Apr 14 01:42:49 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 62/187] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:50 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039d0702-d115-4c25-ab88-d669c6320820", "name": "network-vif-plugged", "status": "completed", "tag": "5b6ccf71-1fe5-4324-a31c-f530be337523"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:50 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:50 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:50 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:50 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] Creating event network-vif-plugged:5b6ccf71-1fe5-4324-a31c-f530be337523 for instance 039d0702-d115-4c25-ab88-d669c6320820 on user Apr 14 01:42:50 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029012 Apr 14 01:42:50 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 64/188] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:53 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0758f1c0-4e50-40c5-a909-4f945b3d8a75 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:53 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-0758f1c0-4e50-40c5-a909-4f945b3d8a75 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:53 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0758f1c0-4e50-40c5-a909-4f945b3d8a75 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0758f1c0-4e50-40c5-a909-4f945b3d8a75 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0758f1c0-4e50-40c5-a909-4f945b3d8a75 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0758f1c0-4e50-40c5-a909-4f945b3d8a75 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0758f1c0-4e50-40c5-a909-4f945b3d8a75 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0758f1c0-4e50-40c5-a909-4f945b3d8a75 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:54 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-0758f1c0-4e50-40c5-a909-4f945b3d8a75 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.107161 Apr 14 01:42:54 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:42:53 2023] GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-interface => generated 282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:55 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f68784e7-578c-4a12-87d4-f35fbc5a1d59", "tag": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] Creating event network-changed:08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 on user Apr 14 01:42:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030279 Apr 14 01:42:55 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 63/190] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e51f02c1-71b8-4c63-9bae-d2210e2363dc"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:56 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:42:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408054 Apr 14 01:42:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 65/191] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:42:56 2023] POST /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:57 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b36a5f8e-ce85-4a36-b545-e7bb4d40cc48 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:57 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b36a5f8e-ce85-4a36-b545-e7bb4d40cc48 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b36a5f8e-ce85-4a36-b545-e7bb4d40cc48 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b36a5f8e-ce85-4a36-b545-e7bb4d40cc48 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b36a5f8e-ce85-4a36-b545-e7bb4d40cc48 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b36a5f8e-ce85-4a36-b545-e7bb4d40cc48 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b36a5f8e-ce85-4a36-b545-e7bb4d40cc48 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b36a5f8e-ce85-4a36-b545-e7bb4d40cc48 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:57 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b36a5f8e-ce85-4a36-b545-e7bb4d40cc48 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.106918 Apr 14 01:42:57 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:42:57 2023] GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-interface => generated 283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:42:58 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d10278-cf24-4fde-86eb-664ba86cbd8f", "tag": "ed3a6f44-e7a4-41b0-9769-71beee125cb1"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:42:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:58 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] Creating event network-changed:ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance f1d10278-cf24-4fde-86eb-664ba86cbd8f on user Apr 14 01:42:58 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032435 Apr 14 01:42:58 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 64/193] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:42:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:42:58 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:42:58 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:42:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:42:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:42:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:42:59 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447da297b18f4e7f86fa94cd4d5d7918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef081a56d11d4b4d82ba5fe6572f3b95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:42:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-9460dd63-d127-45b7-87e5-999cb17bda2f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 200 len: 1433 microversion: 2.1 time: 0.556479 Apr 14 01:42:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 66/194] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:42:58 2023] GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 1433 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:43:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b374309-f641-4369-af29-2e732c69b1e9"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:00 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:00 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=20 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:00 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659420 Apr 14 01:43:00 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 65/195] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:43:00 2023] POST /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:01 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f821a3f4-2f5c-4622-9c3f-e8a22478a09f tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:01 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f821a3f4-2f5c-4622-9c3f-e8a22478a09f tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f821a3f4-2f5c-4622-9c3f-e8a22478a09f tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f821a3f4-2f5c-4622-9c3f-e8a22478a09f tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f821a3f4-2f5c-4622-9c3f-e8a22478a09f tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f821a3f4-2f5c-4622-9c3f-e8a22478a09f tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f821a3f4-2f5c-4622-9c3f-e8a22478a09f tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f821a3f4-2f5c-4622-9c3f-e8a22478a09f tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:01 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f821a3f4-2f5c-4622-9c3f-e8a22478a09f tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.106528 Apr 14 01:43:01 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 65/196] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 01:43:01 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-interface => generated 283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:43:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "tag": "6762a294-eced-41bd-87c0-ac112e954d3a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] Creating event network-changed:6762a294-eced-41bd-87c0-ac112e954d3a for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:43:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 Apr 14 01:43:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 67/197] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:02 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:03 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:03 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:03 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-755b50a4-78e7-472c-8404-b6b9494b3173 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e" status: 200 len: 1627 microversion: 2.49 time: 0.223560 Apr 14 01:43:03 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 66/198] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:43:02 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e => generated 1627 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:43:03 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "tag": "nic-tag"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:03 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0a639fb5-e195-481a-bde7-951b8931b950"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:04 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "tag": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] HTTP exception thrown: Volume 0a639fb5-e195-481a-bde7-951b8931b950 could not be found. Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Request method failure captured: Apr 14 01:43:04 user devstack@n-api.service[61835]: request: PUT /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments/e51f02c1-71b8-4c63-9bae-d2210e2363dc HTTP/1.1 Apr 14 01:43:04 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:43:04 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:43:04 user devstack@n-api.service[61835]: Connection: close Apr 14 01:43:04 user devstack@n-api.service[61835]: Content-Length: 74 Apr 14 01:43:04 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:43:04 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:43:04 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:43:04 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8pH77Nb6pEFav6RPCCoMrO5FD0wNDrFyA1V8e7UMuRZgXt_u1aCpVjABtc5ul0s8Ms23zNLT3Cy7OMLT93GWoivGEkxVUtuQX0-l_Oas_MfASbfZYYpjBXCjSlnAuhh8SpdTEbktQRRZJpp73OKeWBrQZCGZdQ57gBPJes6_27Gm0 Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Project-Id: 7dde6eb092454a70bf1eceb640548536 Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesAdminNegativeTest-1506962359 Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Role: admin,member,reader Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Roles: admin,member,reader Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dde6eb092454a70bf1eceb640548536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7dde6eb092454a70bf1eceb640548536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dde6eb092454a70bf1eceb640548536"}]}] Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesAdminNegativeTest-1506962359 Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Tenant-Id: 7dde6eb092454a70bf1eceb640548536 Apr 14 01:43:04 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1506962359 Apr 14 01:43:04 user devstack@n-api.service[61835]: X-User: tempest-VolumesAdminNegativeTest-1506962359-project-admin Apr 14 01:43:04 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:43:04 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:43:04 user devstack@n-api.service[61835]: X-User-Id: 0136c1c672684e52b5d6cc19de9ab517 Apr 14 01:43:04 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesAdminNegativeTest-1506962359-project-admin Apr 14 01:43:04 user devstack@n-api.service[61835]: Apr 14 01:43:04 user devstack@n-api.service[61835]: {"volumeAttachment": {"volumeId": "0a639fb5-e195-481a-bde7-951b8931b950"}} Apr 14 01:43:04 user devstack@n-api.service[61835]: method: > Apr 14 01:43:04 user devstack@n-api.service[61835]: exception: Volume 0a639fb5-e195-481a-bde7-951b8931b950 could not be found. Apr 14 01:43:04 user devstack@n-api.service[61835]: action_args: {'server_id': 'f68784e7-578c-4a12-87d4-f35fbc5a1d59', 'id': 'e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'body': {'volumeAttachment': {'volumeId': '0a639fb5-e195-481a-bde7-951b8931b950'}}} Apr 14 01:43:04 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a639fb5-e195-481a-bde7-951b8931b950 could not be found. (HTTP 404) (Request-ID: req-f829efb5-5550-4aea-b8b1-c6fdfb09878f) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a639fb5-e195-481a-bde7-951b8931b950 could not be found. Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0a639fb5-e195-481a-bde7-951b8931b950 could not be found. Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a639fb5-e195-481a-bde7-951b8931b950 could not be found. Apr 14 01:43:04 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Returning 400 to user: Volume 0a639fb5-e195-481a-bde7-951b8931b950 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:43:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-4541f9e5-ce57-44ee-a564-1ab18ced3a6e tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments/e51f02c1-71b8-4c63-9bae-d2210e2363dc" status: 400 len: 107 microversion: 2.1 time: 0.488894 Apr 14 01:43:04 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 68/199] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 01:43:04 2023] PUT /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments/e51f02c1-71b8-4c63-9bae-d2210e2363dc => generated 107 bytes in 491 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:43:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] Creating event network-changed:ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:43:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084304 Apr 14 01:43:04 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:05 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:05 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'services' on Instance uuid f68784e7-578c-4a12-87d4-f35fbc5a1d59 {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:43:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments/e51f02c1-71b8-4c63-9bae-d2210e2363dc" status: 202 len: 0 microversion: 2.1 time: 0.246154 Apr 14 01:43:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 69/201] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:43:05 2023] DELETE /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments/e51f02c1-71b8-4c63-9bae-d2210e2363dc => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:43:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3b78bcff-d59d-4429-b8e4-f0ba04c36c60 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:05 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-3b78bcff-d59d-4429-b8e4-f0ba04c36c60 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b78bcff-d59d-4429-b8e4-f0ba04c36c60 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b78bcff-d59d-4429-b8e4-f0ba04c36c60 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b78bcff-d59d-4429-b8e4-f0ba04c36c60 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b78bcff-d59d-4429-b8e4-f0ba04c36c60 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b78bcff-d59d-4429-b8e4-f0ba04c36c60 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b78bcff-d59d-4429-b8e4-f0ba04c36c60 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3b78bcff-d59d-4429-b8e4-f0ba04c36c60 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051977 Apr 14 01:43:05 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:05 2023] GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:06 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-plugged", "status": "completed", "tag": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:06 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] Creating event network-vif-plugged:ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:43:06 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035917 Apr 14 01:43:06 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 70/203] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:06 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:06 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-interface" status: 200 len: 282 microversion: 2.49 time: 3.305188 Apr 14 01:43:06 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 66/204] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 01:43:03 2023] POST /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-interface => generated 282 bytes in 3306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:43:06 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "217c01bb-a21b-4ff9-9e57-99dba019914b", "tag": "volume-tag"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:06 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:06 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.276292 Apr 14 01:43:06 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 69/205] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 01:43:06 2023] POST /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:43:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b713513f-1968-4922-9900-cc42722aaa4b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:07 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b713513f-1968-4922-9900-cc42722aaa4b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b713513f-1968-4922-9900-cc42722aaa4b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b713513f-1968-4922-9900-cc42722aaa4b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b713513f-1968-4922-9900-cc42722aaa4b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b713513f-1968-4922-9900-cc42722aaa4b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b713513f-1968-4922-9900-cc42722aaa4b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b713513f-1968-4922-9900-cc42722aaa4b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b713513f-1968-4922-9900-cc42722aaa4b tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103356 Apr 14 01:43:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 71/206] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:43:07 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-interface => generated 283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-plugged", "status": "completed", "tag": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] Creating event network-vif-plugged:ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:43:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030543 Apr 14 01:43:08 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 67/207] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-de955e4f-5e16-426d-9497-d67967fbf2c3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-de955e4f-5e16-426d-9497-d67967fbf2c3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de955e4f-5e16-426d-9497-d67967fbf2c3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de955e4f-5e16-426d-9497-d67967fbf2c3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de955e4f-5e16-426d-9497-d67967fbf2c3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de955e4f-5e16-426d-9497-d67967fbf2c3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de955e4f-5e16-426d-9497-d67967fbf2c3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-de955e4f-5e16-426d-9497-d67967fbf2c3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-de955e4f-5e16-426d-9497-d67967fbf2c3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047533 Apr 14 01:43:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 70/208] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:08 2023] GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c", "tag": "72f288aa-49e2-407b-9e41-47c8fd81286f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:08 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lazy-loading 'services' on Instance uuid f1d10278-cf24-4fde-86eb-664ba86cbd8f {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:43:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] Creating event network-changed:72f288aa-49e2-407b-9e41-47c8fd81286f for instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c on user Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7113332c-fb29-4657-be57-be86d245b411"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042429 Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:08 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 68/209] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments/9b374309-f641-4369-af29-2e732c69b1e9" status: 202 len: 0 microversion: 2.1 time: 0.172524 Apr 14 01:43:08 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 72/210] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:43:08 2023] DELETE /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments/9b374309-f641-4369-af29-2e732c69b1e9 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:43:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294711 Apr 14 01:43:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 71/211] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:43:08 2023] POST /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:10 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebae9b1685f46aea0064cf83813e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4910c626438f42e9a5db828ae4dae86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-08a6a8d6-061b-40fb-a067-c1d6c0a51024 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1" status: 200 len: 1455 microversion: 2.1 time: 0.160252 Apr 14 01:43:10 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 69/212] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:43:10 2023] GET /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-31f3654f-f3f7-423c-aaee-0d09f5f8dccc tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-31f3654f-f3f7-423c-aaee-0d09f5f8dccc tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-31f3654f-f3f7-423c-aaee-0d09f5f8dccc tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-31f3654f-f3f7-423c-aaee-0d09f5f8dccc tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-31f3654f-f3f7-423c-aaee-0d09f5f8dccc tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-31f3654f-f3f7-423c-aaee-0d09f5f8dccc tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-31f3654f-f3f7-423c-aaee-0d09f5f8dccc tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-31f3654f-f3f7-423c-aaee-0d09f5f8dccc tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-31f3654f-f3f7-423c-aaee-0d09f5f8dccc tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041764 Apr 14 01:43:12 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 73/213] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:12 2023] GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-03f90dcc-a27e-4552-b936-0311ab3113d5 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-03f90dcc-a27e-4552-b936-0311ab3113d5 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-03f90dcc-a27e-4552-b936-0311ab3113d5 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-03f90dcc-a27e-4552-b936-0311ab3113d5 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-03f90dcc-a27e-4552-b936-0311ab3113d5 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-03f90dcc-a27e-4552-b936-0311ab3113d5 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-03f90dcc-a27e-4552-b936-0311ab3113d5 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-03f90dcc-a27e-4552-b936-0311ab3113d5 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-03f90dcc-a27e-4552-b936-0311ab3113d5 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060794 Apr 14 01:43:12 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 72/214] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:12 2023] GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:43:12 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:12 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:12 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:43:12 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f" status: 204 len: 0 microversion: 2.1 time: 0.130085 Apr 14 01:43:12 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 70/215] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:43:12 2023] DELETE /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:12 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1f606719a5435dbcb6092e0708b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9a3bf2a3b4480a990adc9821005f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-c1e203c3-c3d5-4590-8e8b-87ff1fd8d78f tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f" status: 200 len: 1674 microversion: 2.1 time: 0.321447 Apr 14 01:43:12 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 74/216] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:43:12 2023] GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f => generated 1674 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d10278-cf24-4fde-86eb-664ba86cbd8f", "name": "network-vif-unplugged", "status": "completed", "tag": "ed3a6f44-e7a4-41b0-9769-71beee125cb1"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] Creating event network-vif-unplugged:ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance f1d10278-cf24-4fde-86eb-664ba86cbd8f on user Apr 14 01:43:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031911 Apr 14 01:43:12 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 73/217] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:14 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d10278-cf24-4fde-86eb-664ba86cbd8f", "name": "network-vif-deleted", "tag": "ed3a6f44-e7a4-41b0-9769-71beee125cb1"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] Creating event network-vif-deleted:ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance f1d10278-cf24-4fde-86eb-664ba86cbd8f on user Apr 14 01:43:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030328 Apr 14 01:43:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 71/218] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:43:14 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:14 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:14 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'services' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:43:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-volume_attachments/217c01bb-a21b-4ff9-9e57-99dba019914b" status: 202 len: 0 microversion: 2.49 time: 0.177862 Apr 14 01:43:14 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 75/219] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 01:43:14 2023] DELETE /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-volume_attachments/217c01bb-a21b-4ff9-9e57-99dba019914b => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:43:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d10278-cf24-4fde-86eb-664ba86cbd8f", "name": "network-vif-plugged", "status": "completed", "tag": "ed3a6f44-e7a4-41b0-9769-71beee125cb1"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] Creating event network-vif-plugged:ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance f1d10278-cf24-4fde-86eb-664ba86cbd8f on user Apr 14 01:43:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036211 Apr 14 01:43:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 74/220] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:16 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ddd73274-308f-4d71-9930-9ed144269534"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:16 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments/7113332c-fb29-4657-be57-be86d245b411" status: 202 len: 0 microversion: 2.1 time: 0.483189 Apr 14 01:43:16 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 72/221] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 01:43:16 2023] PUT /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments/7113332c-fb29-4657-be57-be86d245b411 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:43:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:17 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-interface/ade69726-e7ad-4fda-8bd1-b5ca2df4d24f" status: 202 len: 0 microversion: 2.49 time: 0.049426 Apr 14 01:43:17 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 76/222] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 01:43:17 2023] DELETE /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-interface/ade69726-e7ad-4fda-8bd1-b5ca2df4d24f => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:43:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-264ba9fb-42b3-4fdb-9931-762af5a06b3c tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-264ba9fb-42b3-4fdb-9931-762af5a06b3c tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-264ba9fb-42b3-4fdb-9931-762af5a06b3c tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-264ba9fb-42b3-4fdb-9931-762af5a06b3c tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-264ba9fb-42b3-4fdb-9931-762af5a06b3c tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-264ba9fb-42b3-4fdb-9931-762af5a06b3c tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-264ba9fb-42b3-4fdb-9931-762af5a06b3c tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-264ba9fb-42b3-4fdb-9931-762af5a06b3c tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-264ba9fb-42b3-4fdb-9931-762af5a06b3c tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-instance-actions/req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c" status: 200 len: 474 microversion: 2.49 time: 0.205248 Apr 14 01:43:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 75/223] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 01:43:17 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-instance-actions/req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c => generated 474 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:43:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-unplugged", "status": "completed", "tag": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] Creating event network-vif-unplugged:ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:43:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035759 Apr 14 01:43:17 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 73/224] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:18 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-deleted", "tag": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:18 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Creating event network-vif-deleted:ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:43:18 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042416 Apr 14 01:43:18 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 77/225] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-plugged", "status": "completed", "tag": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] Creating event network-vif-plugged:ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:43:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031538 Apr 14 01:43:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 76/226] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:24 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:24 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-af5e63e2-f6da-468b-b0e6-febe1ba1ca7e tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6" status: 200 len: 1494 microversion: 2.1 time: 0.221526 Apr 14 01:43:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 74/227] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:43:24 2023] GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 => generated 1494 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=25 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-16cb6ae5-6655-4985-ad2c-176f2b0ddefb tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-16cb6ae5-6655-4985-ad2c-176f2b0ddefb tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16cb6ae5-6655-4985-ad2c-176f2b0ddefb tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16cb6ae5-6655-4985-ad2c-176f2b0ddefb tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16cb6ae5-6655-4985-ad2c-176f2b0ddefb tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16cb6ae5-6655-4985-ad2c-176f2b0ddefb tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16cb6ae5-6655-4985-ad2c-176f2b0ddefb tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16cb6ae5-6655-4985-ad2c-176f2b0ddefb tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:28 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-16cb6ae5-6655-4985-ad2c-176f2b0ddefb tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051356 Apr 14 01:43:28 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 78/228] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:28 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:28 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-c999236d-eba4-479c-b887-65ca0e66884f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:28 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-c999236d-eba4-479c-b887-65ca0e66884f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:28 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=28 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c999236d-eba4-479c-b887-65ca0e66884f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c999236d-eba4-479c-b887-65ca0e66884f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c999236d-eba4-479c-b887-65ca0e66884f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c999236d-eba4-479c-b887-65ca0e66884f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c999236d-eba4-479c-b887-65ca0e66884f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c999236d-eba4-479c-b887-65ca0e66884f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-c999236d-eba4-479c-b887-65ca0e66884f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050074 Apr 14 01:43:28 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 77/229] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:28 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:28 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7113332c-fb29-4657-be57-be86d245b411"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:29 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments/ddd73274-308f-4d71-9930-9ed144269534" status: 202 len: 0 microversion: 2.1 time: 0.281955 Apr 14 01:43:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 75/230] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 01:43:28 2023] PUT /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments/ddd73274-308f-4d71-9930-9ed144269534 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:43:33 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d609a3de-8b50-46a6-8f37-9bb775303833 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '.version_select at 0x7fd421116170>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:33 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d609a3de-8b50-46a6-8f37-9bb775303833 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/images/0abe5ca9-f8b7-4782-9d51-b632ce789e86" status: 200 len: 1722 microversion: 2.1 time: 0.058900 Apr 14 01:43:33 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 79/231] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 01:43:33 2023] GET /compute/v2.1/images/0abe5ca9-f8b7-4782-9d51-b632ce789e86 => generated 1722 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:43:33 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-7b4b41fc-8b09-4e07-afbf-4a169956228a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '.version_select at 0x7fd4213f5c60>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:33 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-7b4b41fc-8b09-4e07-afbf-4a169956228a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/images/0abe5ca9-f8b7-4782-9d51-b632ce789e86" status: 200 len: 1722 microversion: 2.1 time: 0.051339 Apr 14 01:43:33 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 78/232] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 01:43:33 2023] GET /compute/v2.1/images/0abe5ca9-f8b7-4782-9d51-b632ce789e86 => generated 1722 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:43:33 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:33 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:34 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09ab986a00f43b384cf5d517857a13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4833ddea1fa74866b97ef52a730605aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:34 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-980b8982-a49d-4eb1-9cb9-b67fc17038f5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07" status: 200 len: 1671 microversion: 2.1 time: 0.162579 Apr 14 01:43:34 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 76/233] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:43:33 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:43:37 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a3cc0a84-dae5-442e-85cf-a3d42d8b6352 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:37 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a3cc0a84-dae5-442e-85cf-a3d42d8b6352 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3cc0a84-dae5-442e-85cf-a3d42d8b6352 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3cc0a84-dae5-442e-85cf-a3d42d8b6352 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3cc0a84-dae5-442e-85cf-a3d42d8b6352 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3cc0a84-dae5-442e-85cf-a3d42d8b6352 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3cc0a84-dae5-442e-85cf-a3d42d8b6352 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3cc0a84-dae5-442e-85cf-a3d42d8b6352 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:37 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a3cc0a84-dae5-442e-85cf-a3d42d8b6352 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.208717 Apr 14 01:43:37 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 80/234] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 01:43:37 2023] GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/os-interface => generated 1828 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] HTTP exception thrown: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Request method failure captured: Apr 14 01:43:38 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 HTTP/1.1 Apr 14 01:43:38 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:43:38 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:43:38 user devstack@n-api.service[61837]: Connection: close Apr 14 01:43:38 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:43:38 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:43:38 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:43:38 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:43:38 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8bZUJmGd5bHGkFn3I4uqStGx3H5_JxT-L8n4sqY3NiiBIlD58H76g2xk-HQcIXWoSOwR7u17lgKR-h20g30hgm0r6ONjj3Z1oZd2gFNGKfLOSS-qnQVnemp7smyrDtrto1xbClWOadghEpHkOCjuyPwV1RA934FW_7gpd4RuVKo5E Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Project-Id: 50fbd5c190254145815a39079b57881c Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Project-Name: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50fbd5c190254145815a39079b57881c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50fbd5c190254145815a39079b57881c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50fbd5c190254145815a39079b57881c"}]}] Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Tenant: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Tenant-Id: 50fbd5c190254145815a39079b57881c Apr 14 01:43:38 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:38 user devstack@n-api.service[61837]: X-User: tempest-DeleteServersTestJSON-1374716489-project-member Apr 14 01:43:38 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:43:38 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:43:38 user devstack@n-api.service[61837]: X-User-Id: 2fae797718f548fba18e7bc01829f489 Apr 14 01:43:38 user devstack@n-api.service[61837]: X-User-Name: tempest-DeleteServersTestJSON-1374716489-project-member Apr 14 01:43:38 user devstack@n-api.service[61837]: method: > Apr 14 01:43:38 user devstack@n-api.service[61837]: exception: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61837]: action_args: {'id': '039d0702-d115-4c25-ab88-d669c6320820'} Apr 14 01:43:38 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Returning 404 to user: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:43:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ea834fec-7463-46c8-98a4-db465b698dac tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820" status: 404 len: 111 microversion: 2.1 time: 0.053121 Apr 14 01:43:38 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 79/235] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:43:38 2023] GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] HTTP exception thrown: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Request method failure captured: Apr 14 01:43:38 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820/os-volume_attachments HTTP/1.1 Apr 14 01:43:38 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:43:38 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:43:38 user devstack@n-api.service[61836]: Connection: close Apr 14 01:43:38 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:43:38 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:43:38 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:43:38 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:43:38 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8bZUJmGd5bHGkFn3I4uqStGx3H5_JxT-L8n4sqY3NiiBIlD58H76g2xk-HQcIXWoSOwR7u17lgKR-h20g30hgm0r6ONjj3Z1oZd2gFNGKfLOSS-qnQVnemp7smyrDtrto1xbClWOadghEpHkOCjuyPwV1RA934FW_7gpd4RuVKo5E Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Project-Id: 50fbd5c190254145815a39079b57881c Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Project-Name: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50fbd5c190254145815a39079b57881c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50fbd5c190254145815a39079b57881c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50fbd5c190254145815a39079b57881c"}]}] Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Tenant: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Tenant-Id: 50fbd5c190254145815a39079b57881c Apr 14 01:43:38 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:38 user devstack@n-api.service[61836]: X-User: tempest-DeleteServersTestJSON-1374716489-project-member Apr 14 01:43:38 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:43:38 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:43:38 user devstack@n-api.service[61836]: X-User-Id: 2fae797718f548fba18e7bc01829f489 Apr 14 01:43:38 user devstack@n-api.service[61836]: X-User-Name: tempest-DeleteServersTestJSON-1374716489-project-member Apr 14 01:43:38 user devstack@n-api.service[61836]: method: > Apr 14 01:43:38 user devstack@n-api.service[61836]: exception: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61836]: action_args: {'server_id': '039d0702-d115-4c25-ab88-d669c6320820'} Apr 14 01:43:38 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:38 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Returning 404 to user: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:43:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-952289da-fb45-4156-a266-297523bbb3cc tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044466 Apr 14 01:43:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 77/236] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:38 2023] GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 01:43:38 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "tag": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:38 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] Creating event network-changed:3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:38 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056568 Apr 14 01:43:38 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 81/237] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:38 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-8369bd67-60bf-401e-af70-f8c0f5df8f1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" status: 200 len: 2818 microversion: 2.32 time: 0.326777 Apr 14 01:43:38 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 80/238] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:43:38 2023] GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => generated 2818 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c0bf01d0-11f0-49ca-8319-c0eb9e86446a tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-c0bf01d0-11f0-49ca-8319-c0eb9e86446a tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0bf01d0-11f0-49ca-8319-c0eb9e86446a tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0bf01d0-11f0-49ca-8319-c0eb9e86446a tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0bf01d0-11f0-49ca-8319-c0eb9e86446a tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0bf01d0-11f0-49ca-8319-c0eb9e86446a tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0bf01d0-11f0-49ca-8319-c0eb9e86446a tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0bf01d0-11f0-49ca-8319-c0eb9e86446a tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:39 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c0bf01d0-11f0-49ca-8319-c0eb9e86446a tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.156400 Apr 14 01:43:39 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 78/239] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 01:43:38 2023] GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/os-interface => generated 1828 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:43:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" status: 204 len: 0 microversion: 2.32 time: 0.128971 Apr 14 01:43:40 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 82/240] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:43:40 2023] DELETE /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:40 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-unplugged", "status": "completed", "tag": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:40 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:40 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:40 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:40 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-780090ca-3b6d-4bee-b048-17936a970642 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" status: 200 len: 2943 microversion: 2.32 time: 0.312879 Apr 14 01:43:40 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 81/241] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:43:40 2023] GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => generated 2943 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:43:40 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] Creating event network-vif-unplugged:3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:40 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042526 Apr 14 01:43:40 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 79/242] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-unplugged", "status": "completed", "tag": "eee87019-7923-4e16-8e15-f2a1010616e3"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] Creating event network-vif-unplugged:eee87019-7923-4e16-8e15-f2a1010616e3 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065480 Apr 14 01:43:40 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 83/243] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-82216308-dbf0-4eff-bc83-960d82be1825 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-82216308-dbf0-4eff-bc83-960d82be1825 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-82216308-dbf0-4eff-bc83-960d82be1825 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-82216308-dbf0-4eff-bc83-960d82be1825 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-82216308-dbf0-4eff-bc83-960d82be1825 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-82216308-dbf0-4eff-bc83-960d82be1825 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-82216308-dbf0-4eff-bc83-960d82be1825 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-82216308-dbf0-4eff-bc83-960d82be1825 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-82216308-dbf0-4eff-bc83-960d82be1825 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046333 Apr 14 01:43:41 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 82/244] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:41 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f2200034-0c4c-4bd8-bb64-0c4489270226 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f2200034-0c4c-4bd8-bb64-0c4489270226 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2200034-0c4c-4bd8-bb64-0c4489270226 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2200034-0c4c-4bd8-bb64-0c4489270226 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2200034-0c4c-4bd8-bb64-0c4489270226 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2200034-0c4c-4bd8-bb64-0c4489270226 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2200034-0c4c-4bd8-bb64-0c4489270226 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2200034-0c4c-4bd8-bb64-0c4489270226 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f2200034-0c4c-4bd8-bb64-0c4489270226 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057621 Apr 14 01:43:41 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 80/245] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:41 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-unplugged", "status": "completed", "tag": "2b26233c-8774-42ae-9f2f-8794c8e364a1"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] Creating event network-vif-unplugged:2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066199 Apr 14 01:43:41 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 84/246] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lazy-loading 'services' on Instance uuid 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] HTTP exception thrown: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Request method failure captured: Apr 14 01:43:41 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 HTTP/1.1 Apr 14 01:43:41 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:43:41 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:43:41 user devstack@n-api.service[61836]: Connection: close Apr 14 01:43:41 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:43:41 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:43:41 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:43:41 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:43:41 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8bZUJmGd5bHGkFn3I4uqStGx3H5_JxT-L8n4sqY3NiiBIlD58H76g2xk-HQcIXWoSOwR7u17lgKR-h20g30hgm0r6ONjj3Z1oZd2gFNGKfLOSS-qnQVnemp7smyrDtrto1xbClWOadghEpHkOCjuyPwV1RA934FW_7gpd4RuVKo5E Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Project-Id: 50fbd5c190254145815a39079b57881c Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Project-Name: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50fbd5c190254145815a39079b57881c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50fbd5c190254145815a39079b57881c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50fbd5c190254145815a39079b57881c"}]}] Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Tenant: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Tenant-Id: 50fbd5c190254145815a39079b57881c Apr 14 01:43:41 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:41 user devstack@n-api.service[61836]: X-User: tempest-DeleteServersTestJSON-1374716489-project-member Apr 14 01:43:41 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:43:41 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:43:41 user devstack@n-api.service[61836]: X-User-Id: 2fae797718f548fba18e7bc01829f489 Apr 14 01:43:41 user devstack@n-api.service[61836]: X-User-Name: tempest-DeleteServersTestJSON-1374716489-project-member Apr 14 01:43:41 user devstack@n-api.service[61836]: method: > Apr 14 01:43:41 user devstack@n-api.service[61836]: exception: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61836]: action_args: {'id': '039d0702-d115-4c25-ab88-d669c6320820'} Apr 14 01:43:41 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Returning 404 to user: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:43:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-bf56723e-1019-4740-9ba1-263ddd9d1000 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820" status: 404 len: 111 microversion: 2.1 time: 0.062889 Apr 14 01:43:41 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 81/247] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:43:41 2023] DELETE /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments/7113332c-fb29-4657-be57-be86d245b411" status: 202 len: 0 microversion: 2.1 time: 0.418874 Apr 14 01:43:41 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 83/248] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:43:41 2023] DELETE /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments/7113332c-fb29-4657-be57-be86d245b411 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c1f5ed7d-5111-42e5-a82f-b56b5138f200 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-c1f5ed7d-5111-42e5-a82f-b56b5138f200 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1f5ed7d-5111-42e5-a82f-b56b5138f200 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1f5ed7d-5111-42e5-a82f-b56b5138f200 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1f5ed7d-5111-42e5-a82f-b56b5138f200 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1f5ed7d-5111-42e5-a82f-b56b5138f200 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1f5ed7d-5111-42e5-a82f-b56b5138f200 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1f5ed7d-5111-42e5-a82f-b56b5138f200 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] HTTP exception thrown: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Request method failure captured: Apr 14 01:43:41 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 HTTP/1.1 Apr 14 01:43:41 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:43:41 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:43:41 user devstack@n-api.service[61835]: Connection: close Apr 14 01:43:41 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:43:41 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:43:41 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:43:41 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:43:41 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8bZUJmGd5bHGkFn3I4uqStGx3H5_JxT-L8n4sqY3NiiBIlD58H76g2xk-HQcIXWoSOwR7u17lgKR-h20g30hgm0r6ONjj3Z1oZd2gFNGKfLOSS-qnQVnemp7smyrDtrto1xbClWOadghEpHkOCjuyPwV1RA934FW_7gpd4RuVKo5E Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Project-Id: 50fbd5c190254145815a39079b57881c Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Project-Name: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50fbd5c190254145815a39079b57881c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50fbd5c190254145815a39079b57881c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50fbd5c190254145815a39079b57881c"}]}] Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Tenant: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Tenant-Id: 50fbd5c190254145815a39079b57881c Apr 14 01:43:41 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-DeleteServersTestJSON-1374716489 Apr 14 01:43:41 user devstack@n-api.service[61835]: X-User: tempest-DeleteServersTestJSON-1374716489-project-member Apr 14 01:43:41 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:43:41 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:43:41 user devstack@n-api.service[61835]: X-User-Id: 2fae797718f548fba18e7bc01829f489 Apr 14 01:43:41 user devstack@n-api.service[61835]: X-User-Name: tempest-DeleteServersTestJSON-1374716489-project-member Apr 14 01:43:41 user devstack@n-api.service[61835]: method: > Apr 14 01:43:41 user devstack@n-api.service[61835]: exception: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61835]: action_args: {'id': '039d0702-d115-4c25-ab88-d669c6320820'} Apr 14 01:43:41 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. Apr 14 01:43:41 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:43:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Returning 404 to user: Instance 039d0702-d115-4c25-ab88-d669c6320820 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:43:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a32e7381-c3b7-42d5-9ea0-8cf2c51cca0f tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 10.0.0.210 "GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820" status: 404 len: 111 microversion: 2.1 time: 0.092312 Apr 14 01:43:41 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2126586208", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "365cbeec-3756-4258-a135-04112bdda4b4"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:41 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 85/249] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:43:41 2023] GET /compute/v2.1/servers/039d0702-d115-4c25-ab88-d669c6320820 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:43:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c1f5ed7d-5111-42e5-a82f-b56b5138f200 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085255 Apr 14 01:43:41 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 82/250] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:41 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:42 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] validate_networks() for [('365cbeec-3756-4258-a135-04112bdda4b4', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:43:42 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-unplugged", "status": "completed", "tag": "fd852601-98a3-4811-8bf5-120906e84646"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "fd852601-98a3-4811-8bf5-120906e84646"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-unplugged", "status": "completed", "tag": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Creating event network-vif-plugged:3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Creating event network-vif-unplugged:fd852601-98a3-4811-8bf5-120906e84646 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Creating event network-vif-plugged:fd852601-98a3-4811-8bf5-120906e84646 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Creating event network-vif-unplugged:d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Creating event network-vif-plugged:d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.050848 Apr 14 01:43:42 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 86/251] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:42 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:42 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "eee87019-7923-4e16-8e15-f2a1010616e3"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] Creating event network-vif-plugged:eee87019-7923-4e16-8e15-f2a1010616e3 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028815 Apr 14 01:43:42 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 83/252] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:43:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb" status: 204 len: 0 microversion: 2.1 time: 0.143312 Apr 14 01:43:43 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 87/253] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:43:43 2023] DELETE /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "2b26233c-8774-42ae-9f2f-8794c8e364a1"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-unplugged", "status": "completed", "tag": "592ca281-1142-433c-996f-54b6bdce948b"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "592ca281-1142-433c-996f-54b6bdce948b"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b18b911fcf847efbf4f814f3b687279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb176ac656c47b38e736fc629fc46e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-98bd16ed-fb25-4093-a1d6-c755c0ab657a tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb" status: 200 len: 1492 microversion: 2.1 time: 0.279670 Apr 14 01:43:43 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 84/254] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:43:43 2023] GET /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb => generated 1492 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Creating event network-vif-plugged:2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Creating event network-vif-unplugged:592ca281-1142-433c-996f-54b6bdce948b for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Creating event network-vif-plugged:592ca281-1142-433c-996f-54b6bdce948b for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.044020 Apr 14 01:43:43 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 88/255] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:43 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting quotas for project 219c39c8299e46368012a947fdfbe5fd. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting quotas for user 7ed01a83531f4c6bb18a4593284baf05 and project 219c39c8299e46368012a947fdfbe5fd. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:43:43 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:43:43 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.800368 Apr 14 01:43:43 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 84/256] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 01:43:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-276d65ce-fdcf-4223-b43a-9a523da87f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-276d65ce-fdcf-4223-b43a-9a523da87f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-276d65ce-fdcf-4223-b43a-9a523da87f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-276d65ce-fdcf-4223-b43a-9a523da87f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:43 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-276d65ce-fdcf-4223-b43a-9a523da87f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-276d65ce-fdcf-4223-b43a-9a523da87f67 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c" status: 200 len: 1395 microversion: 2.87 time: 0.112728 Apr 14 01:43:43 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 85/257] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:43:43 2023] GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c => generated 1395 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:43:44 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f8e0e9bd-b04c-4390-bf22-721e01a81883 req-c15cfae5-0b3f-46b6-a57d-26fa97288f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9397a9e2-b5e9-47e7-b25e-5c40379a60eb", "name": "network-vif-deleted", "tag": "084feebd-4d90-4eab-b8ec-346c32858b42"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f8e0e9bd-b04c-4390-bf22-721e01a81883 req-c15cfae5-0b3f-46b6-a57d-26fa97288f54 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f8e0e9bd-b04c-4390-bf22-721e01a81883 req-c15cfae5-0b3f-46b6-a57d-26fa97288f54 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f8e0e9bd-b04c-4390-bf22-721e01a81883 req-c15cfae5-0b3f-46b6-a57d-26fa97288f54 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f8e0e9bd-b04c-4390-bf22-721e01a81883 req-c15cfae5-0b3f-46b6-a57d-26fa97288f54 service nova] Creating event network-vif-deleted:084feebd-4d90-4eab-b8ec-346c32858b42 for instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb on user Apr 14 01:43:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f8e0e9bd-b04c-4390-bf22-721e01a81883 req-c15cfae5-0b3f-46b6-a57d-26fa97288f54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036255 Apr 14 01:43:44 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 89/258] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:45 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-unplugged", "status": "completed", "tag": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-plugged", "status": "completed", "tag": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd"}, {"server_uuid": "9397a9e2-b5e9-47e7-b25e-5c40379a60eb", "name": "network-vif-plugged", "status": "completed", "tag": "084feebd-4d90-4eab-b8ec-346c32858b42"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Creating event network-vif-unplugged:933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Creating event network-vif-plugged:933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Creating event network-vif-plugged:084feebd-4d90-4eab-b8ec-346c32858b42 for instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb on user Apr 14 01:43:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.039831 Apr 14 01:43:45 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 85/259] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:45 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:46 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-deleted", "tag": "592ca281-1142-433c-996f-54b6bdce948b"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-deleted", "tag": "2b26233c-8774-42ae-9f2f-8794c8e364a1"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-deleted", "tag": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:46 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] Creating event network-vif-deleted:592ca281-1142-433c-996f-54b6bdce948b for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:46 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] Creating event network-vif-deleted:2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:46 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] Creating event network-vif-deleted:d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:46 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034217 Apr 14 01:43:46 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 86/260] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:46 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:47 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:47 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] Creating event network-changed:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:43:47 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033756 Apr 14 01:43:47 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 90/261] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-adef6b17-4310-4182-80e0-3e45cc49cb8b req-bd15eb40-4f98-40c7-bb8a-d771426f88bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-deleted", "tag": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e"}, {"server_uuid": "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5", "name": "network-vif-deleted", "tag": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-adef6b17-4310-4182-80e0-3e45cc49cb8b req-bd15eb40-4f98-40c7-bb8a-d771426f88bb service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-adef6b17-4310-4182-80e0-3e45cc49cb8b req-bd15eb40-4f98-40c7-bb8a-d771426f88bb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-adef6b17-4310-4182-80e0-3e45cc49cb8b req-bd15eb40-4f98-40c7-bb8a-d771426f88bb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:49 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-adef6b17-4310-4182-80e0-3e45cc49cb8b req-bd15eb40-4f98-40c7-bb8a-d771426f88bb service nova] Creating event network-vif-deleted:3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:49 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-adef6b17-4310-4182-80e0-3e45cc49cb8b req-bd15eb40-4f98-40c7-bb8a-d771426f88bb service nova] Creating event network-vif-deleted:933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 on user Apr 14 01:43:49 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-adef6b17-4310-4182-80e0-3e45cc49cb8b req-bd15eb40-4f98-40c7-bb8a-d771426f88bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034401 Apr 14 01:43:49 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 86/262] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:55 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:55 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-6e7752b4-7105-4e39-bcac-193cdb2d357f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:55 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-6e7752b4-7105-4e39-bcac-193cdb2d357f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e7752b4-7105-4e39-bcac-193cdb2d357f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e7752b4-7105-4e39-bcac-193cdb2d357f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e7752b4-7105-4e39-bcac-193cdb2d357f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e7752b4-7105-4e39-bcac-193cdb2d357f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e7752b4-7105-4e39-bcac-193cdb2d357f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e7752b4-7105-4e39-bcac-193cdb2d357f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-6e7752b4-7105-4e39-bcac-193cdb2d357f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046798 Apr 14 01:43:55 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 87/263] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:43:55 2023] GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2127231950", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "6569db42-40ba-4426-a76b-b3e64ecae5b0"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] validate_networks() for [('6569db42-40ba-4426-a76b-b3e64ecae5b0', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:56 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Getting quotas for project d0a409270d6d4d408de33c5e71a56da9. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:43:56 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Getting quotas for user bbaf843e44ff4359a15ab6d625134b07 and project d0a409270d6d4d408de33c5e71a56da9. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:43:56 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:43:56 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:43:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.488006 Apr 14 01:43:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 91/264] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:43:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:43:56 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:56 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:56 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-905ee656-4eed-4415-8338-c817c1ed387f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:56 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-905ee656-4eed-4415-8338-c817c1ed387f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:56 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-905ee656-4eed-4415-8338-c817c1ed387f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf843e44ff4359a15ab6d625134b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a409270d6d4d408de33c5e71a56da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:56 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-905ee656-4eed-4415-8338-c817c1ed387f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70" status: 200 len: 1212 microversion: 2.1 time: 0.072139 Apr 14 01:43:56 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 87/265] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:43:56 2023] GET /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70 => generated 1212 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:43:58 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-plugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:58 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] Creating event network-vif-plugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:43:58 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027026 Apr 14 01:43:58 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 88/266] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:58 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f045ae6d-889e-40c0-bd71-9b107dba9a70", "tag": "100274c1-800c-4d7f-a6b2-f3f74ec1d682"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:43:58 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:58 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] Creating event network-changed:100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance f045ae6d-889e-40c0-bd71-9b107dba9a70 on user Apr 14 01:43:58 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033551 Apr 14 01:43:58 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 92/267] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:43:59 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447da297b18f4e7f86fa94cd4d5d7918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef081a56d11d4b4d82ba5fe6572f3b95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:43:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-49fa232f-9f44-4ebf-ba6e-c39b005582c8 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 200 len: 1433 microversion: 2.1 time: 0.282986 Apr 14 01:43:59 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 88/268] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:43:59 2023] GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 1433 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-plugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] Creating event network-vif-plugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:44:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039250 Apr 14 01:44:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 89/269] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f045ae6d-889e-40c0-bd71-9b107dba9a70", "name": "network-vif-plugged", "status": "completed", "tag": "100274c1-800c-4d7f-a6b2-f3f74ec1d682"}, {"server_uuid": "f045ae6d-889e-40c0-bd71-9b107dba9a70", "name": "network-vif-plugged", "status": "completed", "tag": "100274c1-800c-4d7f-a6b2-f3f74ec1d682"}, {"name": "network-changed", "server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Creating event network-vif-plugged:100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance f045ae6d-889e-40c0-bd71-9b107dba9a70 on user Apr 14 01:44:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Creating event network-vif-plugged:100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance f045ae6d-889e-40c0-bd71-9b107dba9a70 on user Apr 14 01:44:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Creating event network-changed:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lazy-loading 'flavor' on Instance uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:44:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.041832 Apr 14 01:44:02 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 89/270] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:02 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026/action" status: 202 len: 0 microversion: 2.1 time: 0.159910 Apr 14 01:44:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 93/271] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:44:02 2023] POST /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447da297b18f4e7f86fa94cd4d5d7918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef081a56d11d4b4d82ba5fe6572f3b95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:02 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-1159784c-7ac8-4947-a78d-ea4f67139aeb tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 200 len: 1439 microversion: 2.1 time: 0.198111 Apr 14 01:44:02 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 90/272] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:02 2023] GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 1439 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-unplugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] Creating event network-vif-unplugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:44:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036418 Apr 14 01:44:02 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 90/273] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] HTTP exception thrown: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Request method failure captured: Apr 14 01:44:02 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f HTTP/1.1 Apr 14 01:44:02 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:44:02 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:44:02 user devstack@n-api.service[61835]: Connection: close Apr 14 01:44:02 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:44:02 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:44:02 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:44:02 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:44:02 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8R-ZuAO9drhNywPhoyjIeCWiwTlPY4DyxLcJ-XGsESwJ1V7xenbO9vgPRUZz9SOg6V9cDwX8_rZkM2wK0WM5oBqkUBsZJ7rH6Fu3xTNs7YiXV6b4zGPNyunlnUgSIc-QW0a3MAYtACHP8cNnj_w1vkEnBfIsOjln5zUoeP9wosAlY Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Project-Id: 0d9a3bf2a3b4480a990adc9821005f7f Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-716976075 Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d9a3bf2a3b4480a990adc9821005f7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d9a3bf2a3b4480a990adc9821005f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d9a3bf2a3b4480a990adc9821005f7f"}]}] Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-716976075 Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Tenant-Id: 0d9a3bf2a3b4480a990adc9821005f7f Apr 14 01:44:02 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-716976075 Apr 14 01:44:02 user devstack@n-api.service[61835]: X-User: tempest-AttachSCSIVolumeTestJSON-716976075-project-member Apr 14 01:44:02 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:44:02 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:44:02 user devstack@n-api.service[61835]: X-User-Id: 1a1f606719a5435dbcb6092e0708b2cb Apr 14 01:44:02 user devstack@n-api.service[61835]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-716976075-project-member Apr 14 01:44:02 user devstack@n-api.service[61835]: method: > Apr 14 01:44:02 user devstack@n-api.service[61835]: exception: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:02 user devstack@n-api.service[61835]: action_args: {'id': 'f1d10278-cf24-4fde-86eb-664ba86cbd8f'} Apr 14 01:44:02 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:44:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Returning 404 to user: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:44:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a6231791-07db-4192-8f13-31a037c23b77 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f" status: 404 len: 111 microversion: 2.1 time: 0.031887 Apr 14 01:44:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 94/274] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:02 2023] GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:44:02 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-eec3e055-afe0-405c-8cb2-567c988d84b0 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '.version_select at 0x7fd4210afa30>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:03 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-eec3e055-afe0-405c-8cb2-567c988d84b0 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-698129803" status: 202 len: 0 microversion: 2.1 time: 0.032010 Apr 14 01:44:03 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 91/275] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 01:44:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-698129803 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:44:04 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-plugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}, {"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-plugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}, {"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-plugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Creating event network-vif-plugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:44:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Creating event network-vif-plugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:44:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Creating event network-vif-plugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:44:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044163 Apr 14 01:44:04 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 91/276] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:04 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:06 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-unplugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}, {"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-plugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}, {"name": "network-changed", "server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:06 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:06 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:06 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Creating event network-vif-unplugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:44:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Creating event network-vif-plugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:44:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Creating event network-changed:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:44:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.054933 Apr 14 01:44:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 95/277] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:06 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e1874ecf-1f2f-45d5-9b10-26deca625856 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-e1874ecf-1f2f-45d5-9b10-26deca625856 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e1874ecf-1f2f-45d5-9b10-26deca625856 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e1874ecf-1f2f-45d5-9b10-26deca625856 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e1874ecf-1f2f-45d5-9b10-26deca625856 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e1874ecf-1f2f-45d5-9b10-26deca625856 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e1874ecf-1f2f-45d5-9b10-26deca625856 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e1874ecf-1f2f-45d5-9b10-26deca625856 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e1874ecf-1f2f-45d5-9b10-26deca625856 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-instance-actions/req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c" status: 200 len: 503 microversion: 2.49 time: 0.090560 Apr 14 01:44:07 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 92/278] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 01:44:07 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-instance-actions/req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c => generated 503 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f665da48-8f34-485b-b977-8c822fde75a8 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f665da48-8f34-485b-b977-8c822fde75a8 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f665da48-8f34-485b-b977-8c822fde75a8 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f665da48-8f34-485b-b977-8c822fde75a8 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f665da48-8f34-485b-b977-8c822fde75a8 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f665da48-8f34-485b-b977-8c822fde75a8 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f665da48-8f34-485b-b977-8c822fde75a8 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f665da48-8f34-485b-b977-8c822fde75a8 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:07 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f665da48-8f34-485b-b977-8c822fde75a8 tempest-TaggedAttachmentsTest-1821019852 tempest-TaggedAttachmentsTest-1821019852-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-instance-actions/req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c" status: 200 len: 503 microversion: 2.49 time: 0.057475 Apr 14 01:44:07 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 92/279] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 01:44:07 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-instance-actions/req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c => generated 503 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:44:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f18babbd-77fd-4287-947c-a29ce88c0d5b tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:07 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-f18babbd-77fd-4287-947c-a29ce88c0d5b tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f18babbd-77fd-4287-947c-a29ce88c0d5b tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f18babbd-77fd-4287-947c-a29ce88c0d5b tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f18babbd-77fd-4287-947c-a29ce88c0d5b tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f18babbd-77fd-4287-947c-a29ce88c0d5b tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f18babbd-77fd-4287-947c-a29ce88c0d5b tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f18babbd-77fd-4287-947c-a29ce88c0d5b tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f18babbd-77fd-4287-947c-a29ce88c0d5b tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.045779 Apr 14 01:44:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 96/280] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 01:44:07 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:07 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:44:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e" status: 204 len: 0 microversion: 2.49 time: 0.122008 Apr 14 01:44:07 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 93/281] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:44:07 2023] DELETE /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-0eb4e3cb-f35f-4940-b93f-ecd8905b9d2a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e" status: 200 len: 1752 microversion: 2.49 time: 0.217194 Apr 14 01:44:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 93/282] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:44:07 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:44:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-unplugged", "status": "completed", "tag": "6762a294-eced-41bd-87c0-ac112e954d3a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] Creating event network-vif-unplugged:6762a294-eced-41bd-87c0-ac112e954d3a for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:44:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034284 Apr 14 01:44:08 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 97/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] HTTP exception thrown: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Request method failure captured: Apr 14 01:44:08 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f HTTP/1.1 Apr 14 01:44:08 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:44:08 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:44:08 user devstack@n-api.service[61836]: Connection: close Apr 14 01:44:08 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:44:08 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:44:08 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:44:08 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:44:08 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8R-ZuAO9drhNywPhoyjIeCWiwTlPY4DyxLcJ-XGsESwJ1V7xenbO9vgPRUZz9SOg6V9cDwX8_rZkM2wK0WM5oBqkUBsZJ7rH6Fu3xTNs7YiXV6b4zGPNyunlnUgSIc-QW0a3MAYtACHP8cNnj_w1vkEnBfIsOjln5zUoeP9wosAlY Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Project-Id: 0d9a3bf2a3b4480a990adc9821005f7f Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-716976075 Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d9a3bf2a3b4480a990adc9821005f7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d9a3bf2a3b4480a990adc9821005f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d9a3bf2a3b4480a990adc9821005f7f"}]}] Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-716976075 Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Tenant-Id: 0d9a3bf2a3b4480a990adc9821005f7f Apr 14 01:44:08 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-716976075 Apr 14 01:44:08 user devstack@n-api.service[61836]: X-User: tempest-AttachSCSIVolumeTestJSON-716976075-project-member Apr 14 01:44:08 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:44:08 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:44:08 user devstack@n-api.service[61836]: X-User-Id: 1a1f606719a5435dbcb6092e0708b2cb Apr 14 01:44:08 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-716976075-project-member Apr 14 01:44:08 user devstack@n-api.service[61836]: method: > Apr 14 01:44:08 user devstack@n-api.service[61836]: exception: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61836]: action_args: {'id': 'f1d10278-cf24-4fde-86eb-664ba86cbd8f'} Apr 14 01:44:08 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Returning 404 to user: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:44:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ffa6ed89-3b11-4453-a553-7285c38bf3b6 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f" status: 404 len: 111 microversion: 2.1 time: 0.030933 Apr 14 01:44:08 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 94/284] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:44:08 2023] DELETE /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] HTTP exception thrown: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Request method failure captured: Apr 14 01:44:08 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f HTTP/1.1 Apr 14 01:44:08 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:44:08 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:44:08 user devstack@n-api.service[61837]: Connection: close Apr 14 01:44:08 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:44:08 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:44:08 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:44:08 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:44:08 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8R-ZuAO9drhNywPhoyjIeCWiwTlPY4DyxLcJ-XGsESwJ1V7xenbO9vgPRUZz9SOg6V9cDwX8_rZkM2wK0WM5oBqkUBsZJ7rH6Fu3xTNs7YiXV6b4zGPNyunlnUgSIc-QW0a3MAYtACHP8cNnj_w1vkEnBfIsOjln5zUoeP9wosAlY Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Project-Id: 0d9a3bf2a3b4480a990adc9821005f7f Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-716976075 Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d9a3bf2a3b4480a990adc9821005f7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0d9a3bf2a3b4480a990adc9821005f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0d9a3bf2a3b4480a990adc9821005f7f"}]}] Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-716976075 Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Tenant-Id: 0d9a3bf2a3b4480a990adc9821005f7f Apr 14 01:44:08 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-716976075 Apr 14 01:44:08 user devstack@n-api.service[61837]: X-User: tempest-AttachSCSIVolumeTestJSON-716976075-project-member Apr 14 01:44:08 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:44:08 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:44:08 user devstack@n-api.service[61837]: X-User-Id: 1a1f606719a5435dbcb6092e0708b2cb Apr 14 01:44:08 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-716976075-project-member Apr 14 01:44:08 user devstack@n-api.service[61837]: method: > Apr 14 01:44:08 user devstack@n-api.service[61837]: exception: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61837]: action_args: {'id': 'f1d10278-cf24-4fde-86eb-664ba86cbd8f'} Apr 14 01:44:08 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. Apr 14 01:44:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Returning 404 to user: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:44:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-42226fd6-2a86-417a-b071-b3f3465c85d4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f" status: 404 len: 111 microversion: 2.1 time: 0.030493 Apr 14 01:44:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 94/285] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:08 2023] GET /compute/v2.1/servers/f1d10278-cf24-4fde-86eb-664ba86cbd8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 01:44:10 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-plugged", "status": "completed", "tag": "6762a294-eced-41bd-87c0-ac112e954d3a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:10 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:10 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:10 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f45130b1-9e83-47a0-b335-a6e74875b79e", "name": "network-vif-deleted", "tag": "6762a294-eced-41bd-87c0-ac112e954d3a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] Creating event network-vif-plugged:6762a294-eced-41bd-87c0-ac112e954d3a for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:44:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055188 Apr 14 01:44:10 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 98/286] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] Creating event network-vif-deleted:6762a294-eced-41bd-87c0-ac112e954d3a for instance f45130b1-9e83-47a0-b335-a6e74875b79e on user Apr 14 01:44:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028640 Apr 14 01:44:10 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 95/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:10 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:10 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:10 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:44:11 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1" status: 204 len: 0 microversion: 2.1 time: 0.150160 Apr 14 01:44:11 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 95/288] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:44:10 2023] DELETE /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:44:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:11 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:11 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebae9b1685f46aea0064cf83813e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4910c626438f42e9a5db828ae4dae86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-12eec860-214a-4957-af42-c6f6d6f55a1a tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1" status: 200 len: 1461 microversion: 2.1 time: 0.209082 Apr 14 01:44:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 99/289] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:11 2023] GET /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1 => generated 1461 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:11 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160b86fd-8405-42f5-90b2-8069917e4df1", "name": "network-vif-unplugged", "status": "completed", "tag": "54ba4ed4-462e-4ba6-896d-748b91cfa41e"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:11 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:11 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] Creating event network-vif-unplugged:54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance 160b86fd-8405-42f5-90b2-8069917e4df1 on user Apr 14 01:44:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036368 Apr 14 01:44:11 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 96/290] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e3c5946b-551a-4559-b13e-cb0c1f665e56 req-ef023514-9a34-4e7b-bd5c-b1cff5cc4d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160b86fd-8405-42f5-90b2-8069917e4df1", "name": "network-vif-deleted", "tag": "54ba4ed4-462e-4ba6-896d-748b91cfa41e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e3c5946b-551a-4559-b13e-cb0c1f665e56 req-ef023514-9a34-4e7b-bd5c-b1cff5cc4d33 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e3c5946b-551a-4559-b13e-cb0c1f665e56 req-ef023514-9a34-4e7b-bd5c-b1cff5cc4d33 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e3c5946b-551a-4559-b13e-cb0c1f665e56 req-ef023514-9a34-4e7b-bd5c-b1cff5cc4d33 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e3c5946b-551a-4559-b13e-cb0c1f665e56 req-ef023514-9a34-4e7b-bd5c-b1cff5cc4d33 service nova] Creating event network-vif-deleted:54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance 160b86fd-8405-42f5-90b2-8069917e4df1 on user Apr 14 01:44:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e3c5946b-551a-4559-b13e-cb0c1f665e56 req-ef023514-9a34-4e7b-bd5c-b1cff5cc4d33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053529 Apr 14 01:44:12 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 96/291] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:13 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "160b86fd-8405-42f5-90b2-8069917e4df1", "name": "network-vif-plugged", "status": "completed", "tag": "54ba4ed4-462e-4ba6-896d-748b91cfa41e"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] Creating event network-vif-plugged:54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance 160b86fd-8405-42f5-90b2-8069917e4df1 on user Apr 14 01:44:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030782 Apr 14 01:44:13 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 100/292] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:24 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:44:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6" status: 204 len: 0 microversion: 2.1 time: 0.126601 Apr 14 01:44:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 97/293] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:44:24 2023] DELETE /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:25 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:25 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-6aa678ee-d46b-49e9-9289-84a795cab732 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6" status: 200 len: 1500 microversion: 2.1 time: 0.270950 Apr 14 01:44:25 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 97/294] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:24 2023] GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 => generated 1500 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:25 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=17 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:25 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=19 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:25 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfd39c9-8535-40d0-863d-c30fc98103e6", "name": "network-vif-unplugged", "status": "completed", "tag": "2baffc32-6ecf-4d00-b556-31dc99113a1a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:25 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] Creating event network-vif-unplugged:2baffc32-6ecf-4d00-b556-31dc99113a1a for instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 on user Apr 14 01:44:25 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038897 Apr 14 01:44:25 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 101/295] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:27 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfd39c9-8535-40d0-863d-c30fc98103e6", "name": "network-vif-plugged", "status": "completed", "tag": "2baffc32-6ecf-4d00-b556-31dc99113a1a"}, {"server_uuid": "2dfd39c9-8535-40d0-863d-c30fc98103e6", "name": "network-vif-deleted", "tag": "2baffc32-6ecf-4d00-b556-31dc99113a1a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:27 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] Creating event network-vif-plugged:2baffc32-6ecf-4d00-b556-31dc99113a1a for instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 on user Apr 14 01:44:27 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] Creating event network-vif-deleted:2baffc32-6ecf-4d00-b556-31dc99113a1a for instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 on user Apr 14 01:44:27 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033222 Apr 14 01:44:27 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 98/296] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] HTTP exception thrown: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Request method failure captured: Apr 14 01:44:30 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 HTTP/1.1 Apr 14 01:44:30 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:44:30 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:44:30 user devstack@n-api.service[61837]: Connection: close Apr 14 01:44:30 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:44:30 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:44:30 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:44:30 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:44:30 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8bbA3ntK7qyw6dZ3odnw8DGy4ChUGzTHwekhGfjDSN6WBn-iZs2M23WOwuvVocnmKpafIOc1K-eJkzDxRxDYc16s3ZEX9PvehRQ64VxIwik6xt5cBDggDjPdcw0vhl5BIOB84Wk7uopVR4yqMSnNnbvEAu6Glif86HGqKDLVmCmTY Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Project-Id: 113733a7b1f9424bb5243107472b01c6 Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Project-Name: tempest-TaggedBootDevicesTest-135372045 Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/113733a7b1f9424bb5243107472b01c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/113733a7b1f9424bb5243107472b01c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/113733a7b1f9424bb5243107472b01c6"}]}] Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Tenant: tempest-TaggedBootDevicesTest-135372045 Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Tenant-Id: 113733a7b1f9424bb5243107472b01c6 Apr 14 01:44:30 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TaggedBootDevicesTest-135372045 Apr 14 01:44:30 user devstack@n-api.service[61837]: X-User: tempest-TaggedBootDevicesTest-135372045-project-member Apr 14 01:44:30 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:44:30 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:44:30 user devstack@n-api.service[61837]: X-User-Id: 692d1dd6aa73472a9c63049910360a0b Apr 14 01:44:30 user devstack@n-api.service[61837]: X-User-Name: tempest-TaggedBootDevicesTest-135372045-project-member Apr 14 01:44:30 user devstack@n-api.service[61837]: method: > Apr 14 01:44:30 user devstack@n-api.service[61837]: exception: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:30 user devstack@n-api.service[61837]: action_args: {'id': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'} Apr 14 01:44:30 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:30 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Returning 404 to user: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:44:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-5251d957-62f6-4611-9d0a-accc0d4ff578 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" status: 404 len: 111 microversion: 2.32 time: 0.028343 Apr 14 01:44:30 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 98/297] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:44:30 2023] GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:44:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-61d1bc94-8b65-4b31-9b1a-520c12e6f859 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '.version_select at 0x7fd4210bac20>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-61d1bc94-8b65-4b31-9b1a-520c12e6f859 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529995714" status: 204 len: 0 microversion: 2.32 time: 0.034909 Apr 14 01:44:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 102/298] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 01:44:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529995714 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-b7f0dbec-4aff-4da4-8068-974246fbafdf tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b7f0dbec-4aff-4da4-8068-974246fbafdf tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b7f0dbec-4aff-4da4-8068-974246fbafdf tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b7f0dbec-4aff-4da4-8068-974246fbafdf tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b7f0dbec-4aff-4da4-8068-974246fbafdf tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b7f0dbec-4aff-4da4-8068-974246fbafdf tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b7f0dbec-4aff-4da4-8068-974246fbafdf tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b7f0dbec-4aff-4da4-8068-974246fbafdf tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b7f0dbec-4aff-4da4-8068-974246fbafdf tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043540 Apr 14 01:44:32 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 99/299] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:44:32 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:44:32 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:32 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:32 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:44:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" status: 204 len: 0 microversion: 2.1 time: 0.232744 Apr 14 01:44:32 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 99/300] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:44:32 2023] DELETE /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:44:32 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:32 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:32 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e19e75aa9d4cda971c8d2449e85290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e707623638044e983b557119edd7673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:32 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-fd83e23a-6ded-405e-a82d-c3cdb5c197d6 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" status: 200 len: 1651 microversion: 2.1 time: 0.320542 Apr 14 01:44:32 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 103/301] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:32 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c => generated 1651 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c", "name": "network-vif-unplugged", "status": "completed", "tag": "72f288aa-49e2-407b-9e41-47c8fd81286f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] Creating event network-vif-unplugged:72f288aa-49e2-407b-9e41-47c8fd81286f for instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c on user Apr 14 01:44:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042378 Apr 14 01:44:32 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 100/302] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:33 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] HTTP exception thrown: Instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb could not be found. Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Request method failure captured: Apr 14 01:44:33 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb HTTP/1.1 Apr 14 01:44:33 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:44:33 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:44:33 user devstack@n-api.service[61837]: Connection: close Apr 14 01:44:33 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:44:33 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:44:33 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:44:33 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:44:33 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK9baGzH-xpi9G17flzyH9MAFUyr8Ebhsh1BipH4TPPM7Wi1dYk7oGHdYnL_DT0TM_b4KLST00HtRE9gR33apu3L9RNt7aE0-UUxhLokaO0L9iMc4DN8fS95fEIK4-mtWGLTBBDcc2f7KygsomEwKj9ddNmzXLWjFKex-udN27Ej72w Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Project-Id: cdb176ac656c47b38e736fc629fc46e0 Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Project-Name: tempest-VolumesActionsTest-193871514 Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdb176ac656c47b38e736fc629fc46e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cdb176ac656c47b38e736fc629fc46e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdb176ac656c47b38e736fc629fc46e0"}]}] Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Tenant: tempest-VolumesActionsTest-193871514 Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Tenant-Id: cdb176ac656c47b38e736fc629fc46e0 Apr 14 01:44:33 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-VolumesActionsTest-193871514 Apr 14 01:44:33 user devstack@n-api.service[61837]: X-User: tempest-VolumesActionsTest-193871514-project-member Apr 14 01:44:33 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:44:33 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:44:33 user devstack@n-api.service[61837]: X-User-Id: 8b18b911fcf847efbf4f814f3b687279 Apr 14 01:44:33 user devstack@n-api.service[61837]: X-User-Name: tempest-VolumesActionsTest-193871514-project-member Apr 14 01:44:33 user devstack@n-api.service[61837]: method: > Apr 14 01:44:33 user devstack@n-api.service[61837]: exception: Instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb could not be found. Apr 14 01:44:33 user devstack@n-api.service[61837]: action_args: {'id': '9397a9e2-b5e9-47e7-b25e-5c40379a60eb'} Apr 14 01:44:33 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb could not be found. Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb could not be found. Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb could not be found. Apr 14 01:44:33 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:33 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Returning 404 to user: Instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:44:33 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-92d0a126-e3d6-469d-8680-0a3a29a31cf9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb" status: 404 len: 111 microversion: 2.1 time: 0.042010 Apr 14 01:44:33 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 100/303] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:33 2023] GET /compute/v2.1/servers/9397a9e2-b5e9-47e7-b25e-5c40379a60eb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:44:33 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1283417063", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:33 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] validate_networks() for [('d2f0bf5d-7422-436e-82b2-95cfe8eb77bd', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:44:33 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:33 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:33 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:34 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d58bd68e-a5df-4a12-a8e2-9a71b8c334eb tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c" status: 200 len: 1769 microversion: 2.87 time: 0.327171 Apr 14 01:44:34 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 101/304] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:44:33 2023] GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c => generated 1769 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:44:34 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-551698746", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "9407ec8e-7fa7-49e3-81a0-e6659fd98f5d", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "74c65fc2-ff90-46a4-a5e1-300009f92343"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:34 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] validate_networks() for [('74c65fc2-ff90-46a4-a5e1-300009f92343', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09ab986a00f43b384cf5d517857a13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4833ddea1fa74866b97ef52a730605aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:34 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-3bac5f73-92b6-4768-982e-06672c8473a1 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07" status: 200 len: 1671 microversion: 2.1 time: 0.312750 Apr 14 01:44:34 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 102/305] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:34 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 => generated 1671 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c", "name": "network-vif-plugged", "status": "completed", "tag": "72f288aa-49e2-407b-9e41-47c8fd81286f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:34 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] Creating event network-vif-plugged:72f288aa-49e2-407b-9e41-47c8fd81286f for instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c on user Apr 14 01:44:34 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033643 Apr 14 01:44:34 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 103/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c", "name": "network-vif-deleted", "tag": "72f288aa-49e2-407b-9e41-47c8fd81286f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Getting quotas for project cdb176ac656c47b38e736fc629fc46e0. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:44:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Getting quotas for user 8b18b911fcf847efbf4f814f3b687279 and project cdb176ac656c47b38e736fc629fc46e0. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:44:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] Creating event network-vif-deleted:72f288aa-49e2-407b-9e41-47c8fd81286f for instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c on user Apr 14 01:44:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036585 Apr 14 01:44:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 104/307] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:44:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.707634 Apr 14 01:44:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 104/308] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:44:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 01:44:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-84515252-cc29-4d03-9bcd-604ab7b03100 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:35 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-84515252-cc29-4d03-9bcd-604ab7b03100 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for user 50e3354ac1a84c59a7dee8e1ae6e771a and project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:44:35 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-84515252-cc29-4d03-9bcd-604ab7b03100 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b18b911fcf847efbf4f814f3b687279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb176ac656c47b38e736fc629fc46e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-84515252-cc29-4d03-9bcd-604ab7b03100 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" status: 200 len: 1208 microversion: 2.1 time: 0.083589 Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:44:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 105/309] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:35 2023] GET /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb => generated 1208 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:35 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9407ec8e-7fa7-49e3-81a0-e6659fd98f5d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:44:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.229630 Apr 14 01:44:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 101/310] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:44:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-730467b9-fc01-44a0-aeaf-ec35e69e138e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-730467b9-fc01-44a0-aeaf-ec35e69e138e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:35 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-730467b9-fc01-44a0-aeaf-ec35e69e138e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-730467b9-fc01-44a0-aeaf-ec35e69e138e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" status: 200 len: 1051 microversion: 2.1 time: 0.075278 Apr 14 01:44:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 105/311] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:35 2023] GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => generated 1051 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] HTTP exception thrown: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Request method failure captured: Apr 14 01:44:36 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 HTTP/1.1 Apr 14 01:44:36 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:44:36 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:44:36 user devstack@n-api.service[61836]: Connection: close Apr 14 01:44:36 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:44:36 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:44:36 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:44:36 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:44:36 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8bbA3ntK7qyw6dZ3odnw8DGy4ChUGzTHwekhGfjDSN6WBn-iZs2M23WOwuvVocnmKpafIOc1K-eJkzDxRxDYc16s3ZEX9PvehRQ64VxIwik6xt5cBDggDjPdcw0vhl5BIOB84Wk7uopVR4yqMSnNnbvEAu6Glif86HGqKDLVmCmTY Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Project-Id: 113733a7b1f9424bb5243107472b01c6 Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Project-Name: tempest-TaggedBootDevicesTest-135372045 Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/113733a7b1f9424bb5243107472b01c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/113733a7b1f9424bb5243107472b01c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/113733a7b1f9424bb5243107472b01c6"}]}] Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Tenant: tempest-TaggedBootDevicesTest-135372045 Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Tenant-Id: 113733a7b1f9424bb5243107472b01c6 Apr 14 01:44:36 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-TaggedBootDevicesTest-135372045 Apr 14 01:44:36 user devstack@n-api.service[61836]: X-User: tempest-TaggedBootDevicesTest-135372045-project-member Apr 14 01:44:36 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:44:36 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:44:36 user devstack@n-api.service[61836]: X-User-Id: 692d1dd6aa73472a9c63049910360a0b Apr 14 01:44:36 user devstack@n-api.service[61836]: X-User-Name: tempest-TaggedBootDevicesTest-135372045-project-member Apr 14 01:44:36 user devstack@n-api.service[61836]: method: > Apr 14 01:44:36 user devstack@n-api.service[61836]: exception: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61836]: action_args: {'id': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'} Apr 14 01:44:36 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Returning 404 to user: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:44:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-3fbb7e00-a911-4f3e-9ea7-4b1a583a93ea tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" status: 404 len: 111 microversion: 2.32 time: 0.038424 Apr 14 01:44:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 106/312] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:44:36 2023] DELETE /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] HTTP exception thrown: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Request method failure captured: Apr 14 01:44:36 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 HTTP/1.1 Apr 14 01:44:36 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:44:36 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:44:36 user devstack@n-api.service[61837]: Connection: close Apr 14 01:44:36 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:44:36 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:44:36 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:44:36 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:44:36 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8bbA3ntK7qyw6dZ3odnw8DGy4ChUGzTHwekhGfjDSN6WBn-iZs2M23WOwuvVocnmKpafIOc1K-eJkzDxRxDYc16s3ZEX9PvehRQ64VxIwik6xt5cBDggDjPdcw0vhl5BIOB84Wk7uopVR4yqMSnNnbvEAu6Glif86HGqKDLVmCmTY Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Project-Id: 113733a7b1f9424bb5243107472b01c6 Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Project-Name: tempest-TaggedBootDevicesTest-135372045 Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/113733a7b1f9424bb5243107472b01c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/113733a7b1f9424bb5243107472b01c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/113733a7b1f9424bb5243107472b01c6"}]}] Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Tenant: tempest-TaggedBootDevicesTest-135372045 Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Tenant-Id: 113733a7b1f9424bb5243107472b01c6 Apr 14 01:44:36 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TaggedBootDevicesTest-135372045 Apr 14 01:44:36 user devstack@n-api.service[61837]: X-User: tempest-TaggedBootDevicesTest-135372045-project-member Apr 14 01:44:36 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:44:36 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:44:36 user devstack@n-api.service[61837]: X-User-Id: 692d1dd6aa73472a9c63049910360a0b Apr 14 01:44:36 user devstack@n-api.service[61837]: X-User-Name: tempest-TaggedBootDevicesTest-135372045-project-member Apr 14 01:44:36 user devstack@n-api.service[61837]: method: > Apr 14 01:44:36 user devstack@n-api.service[61837]: exception: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61837]: action_args: {'id': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'} Apr 14 01:44:36 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. Apr 14 01:44:36 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:36 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Returning 404 to user: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:44:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-0f349cfd-64f7-4fdd-ba42-7cc40401c632 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" status: 404 len: 111 microversion: 2.32 time: 0.033731 Apr 14 01:44:36 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 102/313] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:44:36 2023] GET /compute/v2.1/servers/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:44:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7298e05a-b142-4365-95e1-f8551de0ae79"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:36 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357181 Apr 14 01:44:36 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 106/314] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:44:36 2023] POST /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb", "tag": "4a26ba3d-6834-41d3-a4a5-e72c2126b739"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] Creating event network-changed:4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb on user Apr 14 01:44:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051999 Apr 14 01:44:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 107/315] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:44:39 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae", "tag": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:39 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] Creating event network-changed:7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae on user Apr 14 01:44:39 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033113 Apr 14 01:44:39 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 103/316] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:40 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb", "name": "network-vif-plugged", "status": "completed", "tag": "4a26ba3d-6834-41d3-a4a5-e72c2126b739"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] Creating event network-vif-plugged:4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb on user Apr 14 01:44:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038601 Apr 14 01:44:40 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 107/317] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:42 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb", "name": "network-vif-plugged", "status": "completed", "tag": "4a26ba3d-6834-41d3-a4a5-e72c2126b739"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] Creating event network-vif-plugged:4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb on user Apr 14 01:44:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047563 Apr 14 01:44:42 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 108/318] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:44 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "0abe5ca9-f8b7-4782-9d51-b632ce789e86"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:44 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:44 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'flavor' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:44:44 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/action" status: 200 len: 29 microversion: 2.1 time: 0.334195 Apr 14 01:44:44 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 104/319] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:44:44 2023] POST /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/action => generated 29 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:44:44 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:44 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:45 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09ab986a00f43b384cf5d517857a13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4833ddea1fa74866b97ef52a730605aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:45 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-6a662449-82f5-49a1-9257-9423910af5c0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07" status: 200 len: 1723 microversion: 2.1 time: 0.212492 Apr 14 01:44:45 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 108/320] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:44 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:45 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:45 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-unplugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:45 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] Creating event network-vif-unplugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:44:45 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057814 Apr 14 01:44:45 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 109/321] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:46 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf843e44ff4359a15ab6d625134b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a409270d6d4d408de33c5e71a56da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-adcda6f5-24c0-4b45-95ea-2a81dba4ee66 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70" status: 200 len: 1497 microversion: 2.1 time: 0.197665 Apr 14 01:44:46 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 105/322] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:46 2023] GET /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70 => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:47 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:47 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:47 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-plugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:48 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] Creating event network-vif-plugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:44:48 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150168 Apr 14 01:44:48 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 109/323] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:50 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-plugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:50 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:50 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:50 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:50 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] Creating event network-vif-plugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:44:50 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043496 Apr 14 01:44:50 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 110/324] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:52 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-plugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:52 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:52 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:52 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] Creating event network-vif-plugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:44:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:52 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033780 Apr 14 01:44:52 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 106/325] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:52 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447da297b18f4e7f86fa94cd4d5d7918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef081a56d11d4b4d82ba5fe6572f3b95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:44:52 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2307f859-5983-4979-bd97-0410c02dfdef tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 200 len: 1499 microversion: 2.1 time: 0.254160 Apr 14 01:44:52 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 110/326] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:44:52 2023] GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 1499 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:44:54 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae", "name": "network-vif-plugged", "status": "completed", "tag": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f"}, {"server_uuid": "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae", "name": "network-vif-plugged", "status": "completed", "tag": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:44:54 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:54 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:54 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Creating event network-vif-plugged:7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae on user Apr 14 01:44:54 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Creating event network-vif-plugged:7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae on user Apr 14 01:44:54 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046965 Apr 14 01:44:54 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 111/327] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:44:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] HTTP exception thrown: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Request method failure captured: Apr 14 01:44:58 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e HTTP/1.1 Apr 14 01:44:58 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:44:58 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:44:58 user devstack@n-api.service[61837]: Connection: close Apr 14 01:44:58 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:44:58 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:44:58 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:44:58 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:44:58 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8UPMzMA7ihpNTfJhuLsUR5crLlmPKqJHW0y8hMmyFo-MXxvMSYu4r1eVSFNbXsivYcfaB5QUdEmzY4rYSLjfT5zUzNLUc9AzQ1VsQerP9NZmmuQ-7fvybtQ16_0ffnXqEbbjlok0cdDuIUeIx7-eQ9d28BVLG27iQnX-tiDSpmSA0 Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Project-Id: 58f0122cc9864fcea660891e2826ca7b Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Project-Name: tempest-TaggedAttachmentsTest-242857735 Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/58f0122cc9864fcea660891e2826ca7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/58f0122cc9864fcea660891e2826ca7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/58f0122cc9864fcea660891e2826ca7b"}]}] Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Tenant: tempest-TaggedAttachmentsTest-242857735 Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Tenant-Id: 58f0122cc9864fcea660891e2826ca7b Apr 14 01:44:58 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TaggedAttachmentsTest-242857735 Apr 14 01:44:58 user devstack@n-api.service[61837]: X-User: tempest-TaggedAttachmentsTest-242857735-project-member Apr 14 01:44:58 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:44:58 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:44:58 user devstack@n-api.service[61837]: X-User-Id: 2bada5cdb7704f6b956eb48b3729388d Apr 14 01:44:58 user devstack@n-api.service[61837]: X-User-Name: tempest-TaggedAttachmentsTest-242857735-project-member Apr 14 01:44:58 user devstack@n-api.service[61837]: method: > Apr 14 01:44:58 user devstack@n-api.service[61837]: exception: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:44:58 user devstack@n-api.service[61837]: action_args: {'id': 'f45130b1-9e83-47a0-b335-a6e74875b79e'} Apr 14 01:44:58 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:44:58 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:44:58 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Returning 404 to user: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:44:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-48c9ed3c-953b-4c5d-bea4-cdbe601cd3a2 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e" status: 404 len: 111 microversion: 2.49 time: 0.041100 Apr 14 01:44:58 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 107/328] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:44:58 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:44:58 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3380d7be-8300-44b2-9a46-b68ead7e6553 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '.version_select at 0x7fd420fb2320>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:44:58 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:44:58 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-3380d7be-8300-44b2-9a46-b68ead7e6553 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-658101980" status: 204 len: 0 microversion: 2.49 time: 0.028350 Apr 14 01:44:58 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 111/329] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 01:44:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-658101980 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] HTTP exception thrown: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Request method failure captured: Apr 14 01:45:00 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e HTTP/1.1 Apr 14 01:45:00 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:45:00 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:45:00 user devstack@n-api.service[61836]: Connection: close Apr 14 01:45:00 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:45:00 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:45:00 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:45:00 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:45:00 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8UPMzMA7ihpNTfJhuLsUR5crLlmPKqJHW0y8hMmyFo-MXxvMSYu4r1eVSFNbXsivYcfaB5QUdEmzY4rYSLjfT5zUzNLUc9AzQ1VsQerP9NZmmuQ-7fvybtQ16_0ffnXqEbbjlok0cdDuIUeIx7-eQ9d28BVLG27iQnX-tiDSpmSA0 Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Project-Id: 58f0122cc9864fcea660891e2826ca7b Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Project-Name: tempest-TaggedAttachmentsTest-242857735 Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/58f0122cc9864fcea660891e2826ca7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/58f0122cc9864fcea660891e2826ca7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/58f0122cc9864fcea660891e2826ca7b"}]}] Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Tenant: tempest-TaggedAttachmentsTest-242857735 Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Tenant-Id: 58f0122cc9864fcea660891e2826ca7b Apr 14 01:45:00 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-TaggedAttachmentsTest-242857735 Apr 14 01:45:00 user devstack@n-api.service[61836]: X-User: tempest-TaggedAttachmentsTest-242857735-project-member Apr 14 01:45:00 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:45:00 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:45:00 user devstack@n-api.service[61836]: X-User-Id: 2bada5cdb7704f6b956eb48b3729388d Apr 14 01:45:00 user devstack@n-api.service[61836]: X-User-Name: tempest-TaggedAttachmentsTest-242857735-project-member Apr 14 01:45:00 user devstack@n-api.service[61836]: method: > Apr 14 01:45:00 user devstack@n-api.service[61836]: exception: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61836]: action_args: {'id': 'f45130b1-9e83-47a0-b335-a6e74875b79e'} Apr 14 01:45:00 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Returning 404 to user: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:45:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d82ba6bb-3ff5-47e7-8d36-51c21411d85a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e" status: 404 len: 111 microversion: 2.49 time: 0.039013 Apr 14 01:45:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 112/330] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:45:00 2023] DELETE /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:00 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] HTTP exception thrown: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Request method failure captured: Apr 14 01:45:00 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e HTTP/1.1 Apr 14 01:45:00 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:45:00 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:45:00 user devstack@n-api.service[61837]: Connection: close Apr 14 01:45:00 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:45:00 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:45:00 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:45:00 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:45:00 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8UPMzMA7ihpNTfJhuLsUR5crLlmPKqJHW0y8hMmyFo-MXxvMSYu4r1eVSFNbXsivYcfaB5QUdEmzY4rYSLjfT5zUzNLUc9AzQ1VsQerP9NZmmuQ-7fvybtQ16_0ffnXqEbbjlok0cdDuIUeIx7-eQ9d28BVLG27iQnX-tiDSpmSA0 Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Project-Id: 58f0122cc9864fcea660891e2826ca7b Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Project-Name: tempest-TaggedAttachmentsTest-242857735 Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/58f0122cc9864fcea660891e2826ca7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/58f0122cc9864fcea660891e2826ca7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/58f0122cc9864fcea660891e2826ca7b"}]}] Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Tenant: tempest-TaggedAttachmentsTest-242857735 Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Tenant-Id: 58f0122cc9864fcea660891e2826ca7b Apr 14 01:45:00 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TaggedAttachmentsTest-242857735 Apr 14 01:45:00 user devstack@n-api.service[61837]: X-User: tempest-TaggedAttachmentsTest-242857735-project-member Apr 14 01:45:00 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:45:00 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:45:00 user devstack@n-api.service[61837]: X-User-Id: 2bada5cdb7704f6b956eb48b3729388d Apr 14 01:45:00 user devstack@n-api.service[61837]: X-User-Name: tempest-TaggedAttachmentsTest-242857735-project-member Apr 14 01:45:00 user devstack@n-api.service[61837]: method: > Apr 14 01:45:00 user devstack@n-api.service[61837]: exception: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61837]: action_args: {'id': 'f45130b1-9e83-47a0-b335-a6e74875b79e'} Apr 14 01:45:00 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. Apr 14 01:45:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:45:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Returning 404 to user: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:45:00 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b648d2c6-05dc-4f13-8d72-f8e60f884658 tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e" status: 404 len: 111 microversion: 2.49 time: 0.080513 Apr 14 01:45:00 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 108/331] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:45:00 2023] GET /compute/v2.1/servers/f45130b1-9e83-47a0-b335-a6e74875b79e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:01 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] HTTP exception thrown: Instance 160b86fd-8405-42f5-90b2-8069917e4df1 could not be found. Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Request method failure captured: Apr 14 01:45:01 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1 HTTP/1.1 Apr 14 01:45:01 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:45:01 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:45:01 user devstack@n-api.service[61835]: Connection: close Apr 14 01:45:01 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:45:01 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:45:01 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:45:01 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:45:01 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK94B937gDFWH0wy66jRtewGPmZj_S4MALDFLgcRluDKydYOq48aQGfnSXjBxsFXN4TDEgYkVMpPMDgykTDqwdxzSkNh082j6fZrHSRv-Hy6uxrsRPGAVAJjab5ExJArpLnoMJISeuHGOgXj16nS3THjVVzZ_jA0gn6DDPGzb-zzKow Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Project-Id: 4910c626438f42e9a5db828ae4dae86c Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesNegativeTest-116646311 Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4910c626438f42e9a5db828ae4dae86c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4910c626438f42e9a5db828ae4dae86c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4910c626438f42e9a5db828ae4dae86c"}]}] Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesNegativeTest-116646311 Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Tenant-Id: 4910c626438f42e9a5db828ae4dae86c Apr 14 01:45:01 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesNegativeTest-116646311 Apr 14 01:45:01 user devstack@n-api.service[61835]: X-User: tempest-VolumesNegativeTest-116646311-project-member Apr 14 01:45:01 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:45:01 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:45:01 user devstack@n-api.service[61835]: X-User-Id: 8ebae9b1685f46aea0064cf83813e4d8 Apr 14 01:45:01 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesNegativeTest-116646311-project-member Apr 14 01:45:01 user devstack@n-api.service[61835]: method: > Apr 14 01:45:01 user devstack@n-api.service[61835]: exception: Instance 160b86fd-8405-42f5-90b2-8069917e4df1 could not be found. Apr 14 01:45:01 user devstack@n-api.service[61835]: action_args: {'id': '160b86fd-8405-42f5-90b2-8069917e4df1'} Apr 14 01:45:01 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 160b86fd-8405-42f5-90b2-8069917e4df1 could not be found. Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 160b86fd-8405-42f5-90b2-8069917e4df1 could not be found. Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 160b86fd-8405-42f5-90b2-8069917e4df1 could not be found. Apr 14 01:45:01 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:01 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Returning 404 to user: Instance 160b86fd-8405-42f5-90b2-8069917e4df1 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:45:01 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b3e4efeb-3a58-4d30-8bf6-c325581fa6d2 tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] 10.0.0.210 "GET /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1" status: 404 len: 111 microversion: 2.1 time: 0.051142 Apr 14 01:45:01 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 112/332] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:01 2023] GET /compute/v2.1/servers/160b86fd-8405-42f5-90b2-8069917e4df1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:45:06 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-611036692", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:06 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] validate_networks() for [('2c4fba9e-0217-4e37-af1c-065b3f0cd093', None, None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting quotas for project 6d3de04739384e3ea3a475fee28be3c0. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting quotas for user eeb5f26be86e43b3b61fff98fdc83cf3 and project 6d3de04739384e3ea3a475fee28be3c0. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:45:07 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:45:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.766421 Apr 14 01:45:07 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 113/333] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:45:06 2023] POST /compute/v2.1/servers => generated 381 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:45:07 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-4485eac3-4cee-4d2f-b240-2e69354ae29a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:07 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-4485eac3-4cee-4d2f-b240-2e69354ae29a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:07 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-4485eac3-4cee-4d2f-b240-2e69354ae29a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:07 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-4485eac3-4cee-4d2f-b240-2e69354ae29a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc" status: 200 len: 1215 microversion: 2.1 time: 0.183717 Apr 14 01:45:07 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 109/334] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:07 2023] GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2109836040", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:07 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] validate_networks() for [('2c4fba9e-0217-4e37-af1c-065b3f0cd093', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting quotas for project 6d3de04739384e3ea3a475fee28be3c0. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting quotas for user eeb5f26be86e43b3b61fff98fdc83cf3 and project 6d3de04739384e3ea3a475fee28be3c0. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:45:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:45:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.732110 Apr 14 01:45:08 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 113/335] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:45:07 2023] POST /compute/v2.1/servers => generated 381 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:45:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-06a5a0f9-4cae-47a0-ae96-39c14a6f6889 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:08 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-06a5a0f9-4cae-47a0-ae96-39c14a6f6889 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:08 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-06a5a0f9-4cae-47a0-ae96-39c14a6f6889 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-06a5a0f9-4cae-47a0-ae96-39c14a6f6889 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa" status: 200 len: 1216 microversion: 2.1 time: 0.095840 Apr 14 01:45:08 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 114/336] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:08 2023] GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa => generated 1216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:10 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:10 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] Creating event network-changed:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:45:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105443 Apr 14 01:45:10 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 110/337] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] Creating event network-changed:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 01:45:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066105 Apr 14 01:45:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 114/338] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:13 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-plugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}, {"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-plugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:13 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Creating event network-vif-plugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:45:13 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Creating event network-vif-plugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:45:13 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028728 Apr 14 01:45:13 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 115/339] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "name": "network-vif-plugged", "status": "completed", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] Creating event network-vif-plugged:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 01:45:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037096 Apr 14 01:45:14 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 111/340] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:15 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] HTTP exception thrown: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Request method failure captured: Apr 14 01:45:15 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 HTTP/1.1 Apr 14 01:45:15 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:45:15 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:45:15 user devstack@n-api.service[61835]: Connection: close Apr 14 01:45:15 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:45:15 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:45:15 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:45:15 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:45:15 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8XOBsViHuKnHybsXrnQtd_ZJfWj5td05sTbzyiyyn1p8E4CmU9bRusRq99zpd0ETs3wMxsQHcOPYlhDm9qUPTkcGZcTosn0Mo4H3s8_XVoaK3ZA0pMsmloQ8yPZWr5o14A4PeHmRr16oUPZFV3YcuMrZvWpfF9fHy9Ln_BnWQRPEc Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Project-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}] Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Tenant: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Tenant-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:45:15 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:45:15 user devstack@n-api.service[61835]: X-User: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:45:15 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:45:15 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:45:15 user devstack@n-api.service[61835]: X-User-Id: 236828e284154097a25f59eaedf47c29 Apr 14 01:45:15 user devstack@n-api.service[61835]: X-User-Name: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:45:15 user devstack@n-api.service[61835]: method: > Apr 14 01:45:15 user devstack@n-api.service[61835]: exception: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:45:15 user devstack@n-api.service[61835]: action_args: {'id': '2dfd39c9-8535-40d0-863d-c30fc98103e6'} Apr 14 01:45:15 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:45:15 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:15 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Returning 404 to user: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:45:15 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-df63c1c9-d38f-4bbe-9577-668ebbafb0df tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6" status: 404 len: 111 microversion: 2.1 time: 0.045566 Apr 14 01:45:15 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 115/341] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:15 2023] GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:45:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:15 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:15 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-a6fc97ae-e022-43a3-9b9a-6116fc633a17 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a" status: 200 len: 1494 microversion: 2.1 time: 0.239033 Apr 14 01:45:15 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 116/342] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:15 2023] GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a => generated 1494 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:16 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "name": "network-vif-plugged", "status": "completed", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:16 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] Creating event network-vif-plugged:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 01:45:16 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043555 Apr 14 01:45:16 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 112/343] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:22 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] HTTP exception thrown: Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c could not be found. Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Request method failure captured: Apr 14 01:45:22 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c HTTP/1.1 Apr 14 01:45:22 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:45:22 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:45:22 user devstack@n-api.service[61835]: Connection: close Apr 14 01:45:22 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:45:22 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:45:22 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:45:22 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:45:22 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8XgulKOQkOikL0N-FF3sFZd0jcr0v7AHy7cFeOH0BVsg4T9e5XxyApsigP59JOF22QQn_8_efCcvY0mj7lvP1csySVVdeLao_Xo466ZnprR6PT56EHY1jyJoqh0G-gAe2E55LaoI-3GbNMDT8N-a1BupWqm4gO333urSah7Gm2Oq0 Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Project-Id: 3e707623638044e983b557119edd7673 Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Project-Name: tempest-TestVolumeSwap-755712300 Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e707623638044e983b557119edd7673"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e707623638044e983b557119edd7673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e707623638044e983b557119edd7673"}]}] Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Tenant: tempest-TestVolumeSwap-755712300 Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Tenant-Id: 3e707623638044e983b557119edd7673 Apr 14 01:45:22 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-TestVolumeSwap-755712300 Apr 14 01:45:22 user devstack@n-api.service[61835]: X-User: tempest-TestVolumeSwap-755712300-project-member Apr 14 01:45:22 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:45:22 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:45:22 user devstack@n-api.service[61835]: X-User-Id: f6e19e75aa9d4cda971c8d2449e85290 Apr 14 01:45:22 user devstack@n-api.service[61835]: X-User-Name: tempest-TestVolumeSwap-755712300-project-member Apr 14 01:45:22 user devstack@n-api.service[61835]: method: > Apr 14 01:45:22 user devstack@n-api.service[61835]: exception: Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c could not be found. Apr 14 01:45:22 user devstack@n-api.service[61835]: action_args: {'id': '3decf8d9-7bb3-4395-a8b2-91c8dcf1880c'} Apr 14 01:45:22 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c could not be found. Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c could not be found. Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c could not be found. Apr 14 01:45:22 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:45:22 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Returning 404 to user: Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:45:22 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-04554688-c93c-4f02-89e3-9e415f4b2d67 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" status: 404 len: 111 microversion: 2.1 time: 0.045746 Apr 14 01:45:22 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 116/344] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:22 2023] GET /compute/v2.1/servers/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:45:22 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-607a8584-064b-4fe7-b454-931e320fbb58 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Calling method '.version_select at 0x7fd4210f83a0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:22 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:22 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-607a8584-064b-4fe7-b454-931e320fbb58 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595267406" status: 202 len: 0 microversion: 2.1 time: 0.042968 Apr 14 01:45:22 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 117/345] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 01:45:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595267406 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:45:23 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:23 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0674f291-fc6a-4e91-b11e-bea416c5d35d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'create', calling method: .version_select at 0x7fd420f96560>, body: {"keypair": {"name": "tempest-keypair-165395776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ=="}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:23 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-0674f291-fc6a-4e91-b11e-bea416c5d35d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:45:23 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-0674f291-fc6a-4e91-b11e-bea416c5d35d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for user 78ccd1a1ec1b486981d850881734fe02 and project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:45:23 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-0674f291-fc6a-4e91-b11e-bea416c5d35d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.296513 Apr 14 01:45:23 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 113/346] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:45:23 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:25 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-889087873", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775"}], "security_groups": [{"name": "tempest-securitygroup--1165615482"}], "key_name": "tempest-keypair-165395776", "user_data": "}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=13 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:25 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] validate_networks() for [('c74d53a0-681c-4b19-b3a3-f51d6cfc7775', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:45:25 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:25 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:25 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:25 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:25 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:25 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:25 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:25 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:26 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b18b911fcf847efbf4f814f3b687279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb176ac656c47b38e736fc629fc46e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-827d4b07-4148-496c-9fe3-2f9ced7e1ab9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" status: 200 len: 1486 microversion: 2.1 time: 0.382986 Apr 14 01:45:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 118/347] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:25 2023] GET /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb => generated 1486 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:26 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:26 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-dd6ea60c-e3f3-4716-8fde-fb22aceaf8af tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" status: 200 len: 1378 microversion: 2.1 time: 0.343617 Apr 14 01:45:26 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 114/348] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:25 2023] GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => generated 1378 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for user 78ccd1a1ec1b486981d850881734fe02 and project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:45:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:45:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.021863 Apr 14 01:45:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 117/349] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:45:25 2023] POST /compute/v2.1/servers => generated 407 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 01:45:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-9186092f-41a0-42ba-a073-5ac96ffcb553 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:26 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-9186092f-41a0-42ba-a073-5ac96ffcb553 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:26 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-9186092f-41a0-42ba-a073-5ac96ffcb553 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-9186092f-41a0-42ba-a073-5ac96ffcb553 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1231 microversion: 2.1 time: 0.113646 Apr 14 01:45:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 119/350] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:26 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:29 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:29 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] Creating event network-changed:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:45:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036344 Apr 14 01:45:29 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 115/351] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:33 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:33 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:33 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:33 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:33 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:33 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=12 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:33 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:45:33 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056635 Apr 14 01:45:33 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:34 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "a22ab818-1e7f-46f7-9e78-f64813b0fbd6"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:34 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:34 user devstack@n-api.service[61836]: DEBUG nova.objects.instance [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'flavor' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=61836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09ab986a00f43b384cf5d517857a13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4833ddea1fa74866b97ef52a730605aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b3e83c29-b1c8-49fc-91e0-4ca759e07504 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07" status: 200 len: 1703 microversion: 2.1 time: 0.147418 Apr 14 01:45:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 116/353] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:35 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 => generated 1703 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c/action" status: 200 len: 29 microversion: 2.87 time: 0.594779 Apr 14 01:45:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 120/354] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 01:45:34 2023] POST /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c/action => generated 29 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:35 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-adab6fb9-5cb9-4f48-a110-7dd58d4221f8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c" status: 200 len: 1775 microversion: 2.87 time: 0.257866 Apr 14 01:45:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 119/355] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:45:35 2023] GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c => generated 1775 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:45:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039812 Apr 14 01:45:36 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 117/356] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:38 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-unplugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}, {"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-plugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Creating event network-vif-unplugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:45:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Creating event network-vif-plugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:45:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039416 Apr 14 01:45:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 121/357] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:38 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:40 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-plugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:40 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:40 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] Creating event network-vif-plugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:45:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046498 Apr 14 01:45:40 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 120/358] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:42 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-plugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:42 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=23 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] Creating event network-vif-plugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:45:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040350 Apr 14 01:45:42 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 118/359] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:43 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-827bc0b4-29bc-4165-ad25-cc9db6ed6a28 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Action: 'create', calling method: .version_select at 0x7fd4210af490>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-465819654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi1cj7WQkCRTINMDBTK4eWsn4iPECgZryQ4AqN8ZjRlsgtGzjrzAzp3MVZJ+8jfj3WNZWSvuGDFxF6nqqS8dsafPBU9+OLArIsc7EEDH73hlPbPglpvFtiACHZGMdbsdA=="}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:43 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-827bc0b4-29bc-4165-ad25-cc9db6ed6a28 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Getting quotas for project 740488dbb5114fb2b38be20f8ce4adb0. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:45:43 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-827bc0b4-29bc-4165-ad25-cc9db6ed6a28 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Getting quotas for user 34e25e45353e40b9a8bb14736c03fdeb and project 740488dbb5114fb2b38be20f8ce4adb0. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:45:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-827bc0b4-29bc-4165-ad25-cc9db6ed6a28 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.262038 Apr 14 01:45:43 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 122/360] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:45:42 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-155633687", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-465819654", "security_groups": [{"name": "tempest-secgroup-smoke-776968526"}], "networks": [{"uuid": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] validate_networks() for [('31f4b7e9-13bd-4aca-b6c3-a283c637ed63', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Getting quotas for project 740488dbb5114fb2b38be20f8ce4adb0. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Getting quotas for user 34e25e45353e40b9a8bb14736c03fdeb and project 740488dbb5114fb2b38be20f8ce4adb0. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:45:45 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:45:46 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.837095 Apr 14 01:45:46 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 121/361] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:45:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:45:46 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f6370e7b-0877-4e17-a329-d72a79f2f8ba tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:46 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f6370e7b-0877-4e17-a329-d72a79f2f8ba tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:46 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-f6370e7b-0877-4e17-a329-d72a79f2f8ba tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e25e45353e40b9a8bb14736c03fdeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740488dbb5114fb2b38be20f8ce4adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f6370e7b-0877-4e17-a329-d72a79f2f8ba tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800" status: 200 len: 1255 microversion: 2.1 time: 0.105253 Apr 14 01:45:46 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 119/362] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:46 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800 => generated 1255 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6b005472-0fd9-4c6f-928b-6f16bbb13ff1"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] HTTP exception thrown: Volume 7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482 could not be found. Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Request method failure captured: Apr 14 01:45:49 user devstack@n-api.service[61836]: request: PUT /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70/os-volume_attachments/7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482 HTTP/1.1 Apr 14 01:45:49 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:45:49 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:45:49 user devstack@n-api.service[61836]: Connection: close Apr 14 01:45:49 user devstack@n-api.service[61836]: Content-Length: 74 Apr 14 01:45:49 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:45:49 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:45:49 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:45:49 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8pH77Nb6pEFav6RPCCoMrO5FD0wNDrFyA1V8e7UMuRZgXt_u1aCpVjABtc5ul0s8Ms23zNLT3Cy7OMLT93GWoivGEkxVUtuQX0-l_Oas_MfASbfZYYpjBXCjSlnAuhh8SpdTEbktQRRZJpp73OKeWBrQZCGZdQ57gBPJes6_27Gm0 Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Project-Id: 7dde6eb092454a70bf1eceb640548536 Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Project-Name: tempest-VolumesAdminNegativeTest-1506962359 Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Role: admin,member,reader Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Roles: admin,member,reader Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dde6eb092454a70bf1eceb640548536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7dde6eb092454a70bf1eceb640548536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7dde6eb092454a70bf1eceb640548536"}]}] Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Tenant: tempest-VolumesAdminNegativeTest-1506962359 Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Tenant-Id: 7dde6eb092454a70bf1eceb640548536 Apr 14 01:45:49 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1506962359 Apr 14 01:45:49 user devstack@n-api.service[61836]: X-User: tempest-VolumesAdminNegativeTest-1506962359-project-admin Apr 14 01:45:49 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:45:49 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:45:49 user devstack@n-api.service[61836]: X-User-Id: 0136c1c672684e52b5d6cc19de9ab517 Apr 14 01:45:49 user devstack@n-api.service[61836]: X-User-Name: tempest-VolumesAdminNegativeTest-1506962359-project-admin Apr 14 01:45:49 user devstack@n-api.service[61836]: Apr 14 01:45:49 user devstack@n-api.service[61836]: {"volumeAttachment": {"volumeId": "6b005472-0fd9-4c6f-928b-6f16bbb13ff1"}} Apr 14 01:45:49 user devstack@n-api.service[61836]: method: > Apr 14 01:45:49 user devstack@n-api.service[61836]: exception: Volume 7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482 could not be found. Apr 14 01:45:49 user devstack@n-api.service[61836]: action_args: {'server_id': 'f045ae6d-889e-40c0-bd71-9b107dba9a70', 'id': '7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482', 'body': {'volumeAttachment': {'volumeId': '6b005472-0fd9-4c6f-928b-6f16bbb13ff1'}}} Apr 14 01:45:49 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482 could not be found. (HTTP 404) (Request-ID: req-85dda604-2952-4a21-9dce-5cce6f7f52ce) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482 could not be found. Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482 could not be found. Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482 could not be found. Apr 14 01:45:49 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:45:49 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] Returning 404 to user: Volume 7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:45:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-5afb9091-46d0-41c4-a318-2df1f795e6ad tempest-VolumesAdminNegativeTest-1506962359 tempest-VolumesAdminNegativeTest-1506962359-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70/os-volume_attachments/7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482" status: 404 len: 109 microversion: 2.1 time: 0.087723 Apr 14 01:45:49 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 123/363] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 01:45:49 2023] PUT /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70/os-volume_attachments/7e73b96a-8ae2-4c7b-abc7-38d3f3d3a482 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:45:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] Creating event network-changed:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:45:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052554 Apr 14 01:45:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:51 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "name": "network-vif-plugged", "status": "completed", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:52 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] Creating event network-vif-plugged:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:45:52 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057056 Apr 14 01:45:52 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 120/365] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:52 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:52 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:52 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:45:52 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70" status: 204 len: 0 microversion: 2.1 time: 0.198084 Apr 14 01:45:52 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 124/366] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:45:52 2023] DELETE /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:45:52 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:52 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:52 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf843e44ff4359a15ab6d625134b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a409270d6d4d408de33c5e71a56da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:53 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-161ea442-09ef-4d06-8197-f268ccbc8925 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70" status: 200 len: 1503 microversion: 2.1 time: 0.333975 Apr 14 01:45:53 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 123/367] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:52 2023] GET /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70 => generated 1503 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:53 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f045ae6d-889e-40c0-bd71-9b107dba9a70", "name": "network-vif-unplugged", "status": "completed", "tag": "100274c1-800c-4d7f-a6b2-f3f74ec1d682"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:53 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] Creating event network-vif-unplugged:100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance f045ae6d-889e-40c0-bd71-9b107dba9a70 on user Apr 14 01:45:53 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.302385 Apr 14 01:45:53 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 121/368] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:53 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61836) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 01:45:53 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026/action" status: 202 len: 0 microversion: 2.1 time: 0.414001 Apr 14 01:45:53 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 125/369] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:45:53 2023] POST /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:45:53 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:53 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:53 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447da297b18f4e7f86fa94cd4d5d7918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef081a56d11d4b4d82ba5fe6572f3b95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:53 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-466dd2d1-5309-42ee-850b-1fb39e918c41 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 200 len: 1507 microversion: 2.1 time: 0.230485 Apr 14 01:45:53 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 124/370] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:53 2023] GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:45:54 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "name": "network-vif-plugged", "status": "completed", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:54 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] Creating event network-vif-plugged:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:45:54 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043437 Apr 14 01:45:54 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 122/371] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:45:54 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f045ae6d-889e-40c0-bd71-9b107dba9a70", "name": "network-vif-deleted", "tag": "100274c1-800c-4d7f-a6b2-f3f74ec1d682"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:54 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] Creating event network-vif-deleted:100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance f045ae6d-889e-40c0-bd71-9b107dba9a70 on user Apr 14 01:45:54 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054884 Apr 14 01:45:54 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 126/372] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:55 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f045ae6d-889e-40c0-bd71-9b107dba9a70", "name": "network-vif-plugged", "status": "completed", "tag": "100274c1-800c-4d7f-a6b2-f3f74ec1d682"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:45:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:55 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] Creating event network-vif-plugged:100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance f045ae6d-889e-40c0-bd71-9b107dba9a70 on user Apr 14 01:45:55 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033917 Apr 14 01:45:55 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 125/373] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:45:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:45:58 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:45:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-0cee651a-245f-41eb-809e-77154e84d26a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa" status: 200 len: 1504 microversion: 2.1 time: 0.168096 Apr 14 01:45:58 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 123/374] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:45:58 2023] GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:01 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:01 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:01 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] Creating event network-changed:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:46:01 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122083 Apr 14 01:46:01 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 127/375] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-plugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:04 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:04 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:04 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=28 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] Creating event network-vif-plugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:46:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050906 Apr 14 01:46:04 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 126/376] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:06 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-plugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:06 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=20 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:06 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] Creating event network-vif-plugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:46:06 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054149 Apr 14 01:46:06 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 124/377] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:11 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:11 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-15553721-97b6-462b-8189-596300cd7f24 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Action: 'create', calling method: .version_select at 0x7fd420fb8040>, body: {"keypair": {"name": "tempest-keypair-1639753774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ=="}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:11 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-15553721-97b6-462b-8189-596300cd7f24 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Getting quotas for project 7782019f67b04982a58ed5272dc4cbb5. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:46:11 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-15553721-97b6-462b-8189-596300cd7f24 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Getting quotas for user c4e5234d2ffe4dc898d22be4bd648c47 and project 7782019f67b04982a58ed5272dc4cbb5. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:46:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-15553721-97b6-462b-8189-596300cd7f24 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.067103 Apr 14 01:46:11 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 128/378] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 01:46:11 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 01:46:12 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1084378513", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "92cd3f98-b66a-42aa-a5fa-47916885d4d3"}, {"port": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "tag": "port-1"}, {"port": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "tag": "port-2"}, {"uuid": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "tag": "net-1"}, {"uuid": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6"}, {"uuid": "7b28d758-6a84-4044-814b-714f0f210494", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7b28d758-6a84-4044-814b-714f0f210494", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "dccc3a21-0674-4347-842b-3d0354dfdfa8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f01988fc-537f-4359-9b58-2a3f4752251b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ae6f77e9-ea6d-4653-9cd8-5944d88d743d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--148438982"}], "key_name": "tempest-keypair-1639753774", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:12 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:12 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] validate_networks() for [('92cd3f98-b66a-42aa-a5fa-47916885d4d3', None, None, None, None, None), (None, None, '4e9a3669-2ccb-49fc-a153-dfcee715ad41', None, None, None), (None, None, 'b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a', None, None, None), ('3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6', None, None, None, None, None), ('3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6', None, None, None, None, None), ('7b28d758-6a84-4044-814b-714f0f210494', '10.2.2.100', None, None, None, None), ('7b28d758-6a84-4044-814b-714f0f210494', '10.2.2.200', None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Getting quotas for project 7782019f67b04982a58ed5272dc4cbb5. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Getting quotas for user c4e5234d2ffe4dc898d22be4bd648c47 and project 7782019f67b04982a58ed5272dc4cbb5. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:46:14 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='dccc3a21-0674-4347-842b-3d0354dfdfa8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f01988fc-537f-4359-9b58-2a3f4752251b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae6f77e9-ea6d-4653-9cd8-5944d88d743d',volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:46:15 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 2.401755 Apr 14 01:46:15 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 127/379] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 01:46:12 2023] POST /compute/v2.1/servers => generated 403 bytes in 2403 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 01:46:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-112e9233-98e6-42e7-a0bb-e5d171be00b9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:15 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-112e9233-98e6-42e7-a0bb-e5d171be00b9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-112e9233-98e6-42e7-a0bb-e5d171be00b9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-112e9233-98e6-42e7-a0bb-e5d171be00b9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-112e9233-98e6-42e7-a0bb-e5d171be00b9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-112e9233-98e6-42e7-a0bb-e5d171be00b9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60" status: 200 len: 1280 microversion: 2.42 time: 0.074700 Apr 14 01:46:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 125/380] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:46:15 2023] GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 01:46:16 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:16 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:16 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d5a0bf0a-5fbd-446c-8430-8c78a37561be tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1538 microversion: 2.1 time: 0.263715 Apr 14 01:46:16 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 129/381] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:16 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1538 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-224e22a3-36ad-46c8-9916-55f268a36141 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1244522264", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f9186595-102b-4861-bf47-eda6b312e3a6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "93155729-11d3-4eff-bbd2-8860a881e233"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-224e22a3-36ad-46c8-9916-55f268a36141 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] HTTP exception thrown: Block Device f9186595-102b-4861-bf47-eda6b312e3a6 is not bootable. Apr 14 01:46:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-224e22a3-36ad-46c8-9916-55f268a36141 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Request method failure captured: Apr 14 01:46:17 user devstack@n-api.service[61835]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 01:46:17 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:46:17 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:46:17 user devstack@n-api.service[61835]: Connection: close Apr 14 01:46:17 user devstack@n-api.service[61835]: Content-Length: 357 Apr 14 01:46:17 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:46:17 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:46:17 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:46:17 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8XOBsViHuKnHybsXrnQtd_ZJfWj5td05sTbzyiyyn1p8E4CmU9bRusRq99zpd0ETs3wMxsQHcOPYlhDm9qUPTkcGZcTosn0Mo4H3s8_XVoaK3ZA0pMsmloQ8yPZWr5o14A4PeHmRr16oUPZFV3YcuMrZvWpfF9fHy9Ln_BnWQRPEc Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Project-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}] Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Tenant: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Tenant-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:46:17 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:46:17 user devstack@n-api.service[61835]: X-User: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:46:17 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:46:17 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:46:17 user devstack@n-api.service[61835]: X-User-Id: 236828e284154097a25f59eaedf47c29 Apr 14 01:46:17 user devstack@n-api.service[61835]: X-User-Name: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:46:17 user devstack@n-api.service[61835]: Apr 14 01:46:17 user devstack@n-api.service[61835]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1244522264", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "f9186595-102b-4861-bf47-eda6b312e3a6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "93155729-11d3-4eff-bbd2-8860a881e233"}]}} Apr 14 01:46:17 user devstack@n-api.service[61835]: method: > Apr 14 01:46:17 user devstack@n-api.service[61835]: exception: Block Device f9186595-102b-4861-bf47-eda6b312e3a6 is not bootable. Apr 14 01:46:17 user devstack@n-api.service[61835]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1244522264', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'f9186595-102b-4861-bf47-eda6b312e3a6'}], 'networks': [{'uuid': '93155729-11d3-4eff-bbd2-8860a881e233'}]}}} Apr 14 01:46:17 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device f9186595-102b-4861-bf47-eda6b312e3a6 is not bootable. Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device f9186595-102b-4861-bf47-eda6b312e3a6 is not bootable. Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device f9186595-102b-4861-bf47-eda6b312e3a6 is not bootable. Apr 14 01:46:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-224e22a3-36ad-46c8-9916-55f268a36141 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Returning 400 to user: Block Device f9186595-102b-4861-bf47-eda6b312e3a6 is not bootable. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:46:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-224e22a3-36ad-46c8-9916-55f268a36141 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.077742 Apr 14 01:46:17 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 128/382] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:46:17 2023] POST /compute/v2.1/servers => generated 110 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=15 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:17 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-71e58913-c6be-4872-a882-d949f5cb0289 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a" status: 200 len: 1494 microversion: 2.1 time: 0.266466 Apr 14 01:46:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 126/383] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:17 2023] GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a => generated 1494 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:21 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "tag": "0912c834-ed73-4f3a-9419-2c08d6094b93"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] Creating event network-changed:0912c834-ed73-4f3a-9419-2c08d6094b93 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028833 Apr 14 01:46:21 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 130/384] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:23 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "tag": "4e9a3669-2ccb-49fc-a153-dfcee715ad41"}, {"name": "network-changed", "server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "tag": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Creating event network-changed:4e9a3669-2ccb-49fc-a153-dfcee715ad41 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Creating event network-changed:b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039625 Apr 14 01:46:23 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 129/385] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:23 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:25 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "tag": "6532dff7-2168-407f-be9b-bdbea1b6edd4"}, {"name": "network-changed", "server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "tag": "f12d4d92-cf6a-4908-a203-d32ad80cb617"}, {"name": "network-changed", "server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "tag": "6517ba71-e7ec-4e68-8860-714bb4711368"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:25 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:25 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:25 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:25 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Creating event network-changed:6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:25 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Creating event network-changed:f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:25 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Creating event network-changed:6517ba71-e7ec-4e68-8860-714bb4711368 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:25 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.032306 Apr 14 01:46:25 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 127/386] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:25 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:25 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:25 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b33c1f94-0bf2-4057-b5a4-118bd8a1d845 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c" status: 200 len: 1755 microversion: 2.87 time: 0.300989 Apr 14 01:46:25 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 131/387] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:46:25 2023] GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c => generated 1755 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f3670e30-2018-46f1-9aa0-cc57282f305a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" status: 200 len: 1378 microversion: 2.1 time: 0.156163 Apr 14 01:46:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 130/388] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:26 2023] GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => generated 1378 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:26 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-6c2a1fe6-dfdb-4cd8-925b-0faf23d0164e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" status: 200 len: 1378 microversion: 2.1 time: 0.179762 Apr 14 01:46:26 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 128/389] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:26 2023] GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => generated 1378 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:46:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:46:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" status: 204 len: 0 microversion: 2.1 time: 0.122890 Apr 14 01:46:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 132/390] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:46:26 2023] DELETE /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" status: 204 len: 0 microversion: 2.1 time: 0.127201 Apr 14 01:46:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 131/391] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:46:26 2023] DELETE /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:26 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b18b911fcf847efbf4f814f3b687279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb176ac656c47b38e736fc629fc46e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:26 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e5dde1f9-2777-4da2-9931-e25ccd6c1f37 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" status: 200 len: 1492 microversion: 2.1 time: 0.151407 Apr 14 01:46:26 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 129/392] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:26 2023] GET /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb => generated 1492 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:26 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e185cf16-375a-4dae-9421-42a1fe83fed3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" status: 200 len: 1384 microversion: 2.1 time: 0.172973 Apr 14 01:46:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 133/393] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:26 2023] GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => generated 1384 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "tag": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] Creating event network-changed:9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042684 Apr 14 01:46:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 132/394] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb", "name": "network-vif-unplugged", "status": "completed", "tag": "4a26ba3d-6834-41d3-a4a5-e72c2126b739"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] Creating event network-vif-unplugged:4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb on user Apr 14 01:46:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121484 Apr 14 01:46:27 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 130/395] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:29 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-4469d4bf-773c-41de-804c-c31adcb655ba req-ef3a227c-8d9f-487c-b77d-09dc37df8076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb", "name": "network-vif-deleted", "tag": "4a26ba3d-6834-41d3-a4a5-e72c2126b739"}, {"server_uuid": "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae", "name": "network-vif-deleted", "tag": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4469d4bf-773c-41de-804c-c31adcb655ba req-ef3a227c-8d9f-487c-b77d-09dc37df8076 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4469d4bf-773c-41de-804c-c31adcb655ba req-ef3a227c-8d9f-487c-b77d-09dc37df8076 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4469d4bf-773c-41de-804c-c31adcb655ba req-ef3a227c-8d9f-487c-b77d-09dc37df8076 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-4469d4bf-773c-41de-804c-c31adcb655ba req-ef3a227c-8d9f-487c-b77d-09dc37df8076 service nova] Creating event network-vif-deleted:4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb on user Apr 14 01:46:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-4469d4bf-773c-41de-804c-c31adcb655ba req-ef3a227c-8d9f-487c-b77d-09dc37df8076 service nova] Creating event network-vif-deleted:7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae on user Apr 14 01:46:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-4469d4bf-773c-41de-804c-c31adcb655ba req-ef3a227c-8d9f-487c-b77d-09dc37df8076 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036235 Apr 14 01:46:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 134/396] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb", "name": "network-vif-plugged", "status": "completed", "tag": "4a26ba3d-6834-41d3-a4a5-e72c2126b739"}, {"server_uuid": "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae", "name": "network-vif-unplugged", "status": "completed", "tag": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f"}, {"server_uuid": "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae", "name": "network-vif-plugged", "status": "completed", "tag": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Creating event network-vif-plugged:4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb on user Apr 14 01:46:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Creating event network-vif-unplugged:7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae on user Apr 14 01:46:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Creating event network-vif-plugged:7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae on user Apr 14 01:46:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.039444 Apr 14 01:46:29 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 133/397] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:29 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:35 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/action" status: 202 len: 0 microversion: 2.1 time: 0.185269 Apr 14 01:46:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 131/398] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:46:35 2023] POST /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:46:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-8a6928e3-8a1f-4d2b-a7a1-0c1046e23587 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:35 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-8a6928e3-8a1f-4d2b-a7a1-0c1046e23587 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8a6928e3-8a1f-4d2b-a7a1-0c1046e23587 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8a6928e3-8a1f-4d2b-a7a1-0c1046e23587 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8a6928e3-8a1f-4d2b-a7a1-0c1046e23587 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8a6928e3-8a1f-4d2b-a7a1-0c1046e23587 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8a6928e3-8a1f-4d2b-a7a1-0c1046e23587 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8a6928e3-8a1f-4d2b-a7a1-0c1046e23587 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-8a6928e3-8a1f-4d2b-a7a1-0c1046e23587 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.095203 Apr 14 01:46:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 135/399] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:46:35 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-interface => generated 282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:36 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e25e45353e40b9a8bb14736c03fdeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740488dbb5114fb2b38be20f8ce4adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-c8605661-48a3-4ae9-b724-33f18caa13cc tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800" status: 200 len: 1565 microversion: 2.1 time: 0.173303 Apr 14 01:46:36 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 134/400] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:36 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 01:46:36 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-unplugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] Creating event network-vif-unplugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:46:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035198 Apr 14 01:46:36 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 132/401] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-plugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}, {"name": "network-changed", "server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}, {"name": "network-changed", "server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Creating event network-vif-plugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:46:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Creating event network-changed:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:46:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Creating event network-changed:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:46:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.031228 Apr 14 01:46:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 136/402] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:38 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:39 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "0912c834-ed73-4f3a-9419-2c08d6094b93"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] Creating event network-vif-plugged:0912c834-ed73-4f3a-9419-2c08d6094b93 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032707 Apr 14 01:46:39 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 135/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:40 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:40 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=20 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] Creating event network-vif-plugged:b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056336 Apr 14 01:46:40 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 133/404] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:40 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-plugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}, {"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-plugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "4e9a3669-2ccb-49fc-a153-dfcee715ad41"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "4e9a3669-2ccb-49fc-a153-dfcee715ad41"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:40 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:40 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:40 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:40 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Creating event network-vif-plugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:46:40 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Creating event network-vif-plugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:46:40 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Creating event network-vif-plugged:4e9a3669-2ccb-49fc-a153-dfcee715ad41 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:40 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Creating event network-vif-plugged:4e9a3669-2ccb-49fc-a153-dfcee715ad41 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:40 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.044754 Apr 14 01:46:40 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 137/405] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:40 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "0912c834-ed73-4f3a-9419-2c08d6094b93"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "6532dff7-2168-407f-be9b-bdbea1b6edd4"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "6532dff7-2168-407f-be9b-bdbea1b6edd4"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Creating event network-vif-plugged:0912c834-ed73-4f3a-9419-2c08d6094b93 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Creating event network-vif-plugged:6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Creating event network-vif-plugged:6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032937 Apr 14 01:46:41 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 136/406] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:41 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:42 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "f12d4d92-cf6a-4908-a203-d32ad80cb617"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "f12d4d92-cf6a-4908-a203-d32ad80cb617"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Creating event network-vif-plugged:b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Creating event network-vif-plugged:f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Creating event network-vif-plugged:f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.049970 Apr 14 01:46:42 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 134/407] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:42 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:42 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "6517ba71-e7ec-4e68-8860-714bb4711368"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "6517ba71-e7ec-4e68-8860-714bb4711368"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:42 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:42 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Creating event network-vif-plugged:6517ba71-e7ec-4e68-8860-714bb4711368 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Creating event network-vif-plugged:6517ba71-e7ec-4e68-8860-714bb4711368 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041215 Apr 14 01:46:42 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 138/408] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] HTTP exception thrown: Instance f045ae6d-889e-40c0-bd71-9b107dba9a70 could not be found. Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Request method failure captured: Apr 14 01:46:43 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70 HTTP/1.1 Apr 14 01:46:43 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:46:43 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:46:43 user devstack@n-api.service[61835]: Connection: close Apr 14 01:46:43 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:46:43 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:46:43 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:46:43 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:46:43 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8XYWnI5EskdN7Hi6phikXNwf0Lukb1lklhlvmZhLFI7VQfLB_U2cZBqznIbEODElrTYdk87x-3Ck7LfQaNFj57RL1UeEIzHW26HzNXDXPZsERWydj-sIX-KhMd5zBg80Sou-OPUO6MFpYHVvQLumJO3q4tLkDpQ0xdqcmbGdWdS2g Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Project-Id: d0a409270d6d4d408de33c5e71a56da9 Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesAdminNegativeTest-1981219566 Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0a409270d6d4d408de33c5e71a56da9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d0a409270d6d4d408de33c5e71a56da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0a409270d6d4d408de33c5e71a56da9"}]}] Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesAdminNegativeTest-1981219566 Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Tenant-Id: d0a409270d6d4d408de33c5e71a56da9 Apr 14 01:46:43 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1981219566 Apr 14 01:46:43 user devstack@n-api.service[61835]: X-User: tempest-VolumesAdminNegativeTest-1981219566-project-member Apr 14 01:46:43 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:46:43 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:46:43 user devstack@n-api.service[61835]: X-User-Id: bbaf843e44ff4359a15ab6d625134b07 Apr 14 01:46:43 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesAdminNegativeTest-1981219566-project-member Apr 14 01:46:43 user devstack@n-api.service[61835]: method: > Apr 14 01:46:43 user devstack@n-api.service[61835]: exception: Instance f045ae6d-889e-40c0-bd71-9b107dba9a70 could not be found. Apr 14 01:46:43 user devstack@n-api.service[61835]: action_args: {'id': 'f045ae6d-889e-40c0-bd71-9b107dba9a70'} Apr 14 01:46:43 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f045ae6d-889e-40c0-bd71-9b107dba9a70 could not be found. Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f045ae6d-889e-40c0-bd71-9b107dba9a70 could not be found. Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f045ae6d-889e-40c0-bd71-9b107dba9a70 could not be found. Apr 14 01:46:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:46:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Returning 404 to user: Instance f045ae6d-889e-40c0-bd71-9b107dba9a70 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:46:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-c23d981f-8da7-4d78-b358-60efd23aeb16 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70" status: 404 len: 111 microversion: 2.1 time: 0.183365 Apr 14 01:46:43 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 137/409] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:43 2023] GET /compute/v2.1/servers/f045ae6d-889e-40c0-bd71-9b107dba9a70 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:46:43 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:43 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:43 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Creating event network-vif-plugged:9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Creating event network-vif-plugged:9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:46:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036454 Apr 14 01:46:43 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 139/410] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:43 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447da297b18f4e7f86fa94cd4d5d7918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef081a56d11d4b4d82ba5fe6572f3b95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:43 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-a5e41b07-d7db-4076-ae2b-276c3dd6f88c tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 200 len: 1552 microversion: 2.1 time: 0.172719 Apr 14 01:46:43 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 135/411] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:43 2023] GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:46 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:46 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:46 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:46 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:46 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:46 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:46 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:46 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:46 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:46:46 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59" status: 204 len: 0 microversion: 2.1 time: 0.157970 Apr 14 01:46:46 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 138/412] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:46:46 2023] DELETE /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:46:46 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:46 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:46 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbaf843e44ff4359a15ab6d625134b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a409270d6d4d408de33c5e71a56da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-6864af53-54bc-4c84-96da-f1be6edc1879 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59" status: 200 len: 1670 microversion: 2.1 time: 0.266542 Apr 14 01:46:47 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 140/413] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:46 2023] GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59 => generated 1670 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:47 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68784e7-578c-4a12-87d4-f35fbc5a1d59", "name": "network-vif-unplugged", "status": "completed", "tag": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:47 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] Creating event network-vif-unplugged:08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 on user Apr 14 01:46:47 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046116 Apr 14 01:46:47 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 136/414] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f68784e7-578c-4a12-87d4-f35fbc5a1d59", "name": "network-vif-plugged", "status": "completed", "tag": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd"}, {"server_uuid": "f68784e7-578c-4a12-87d4-f35fbc5a1d59", "name": "network-vif-deleted", "tag": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] Creating event network-vif-plugged:08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 on user Apr 14 01:46:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] Creating event network-vif-deleted:08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 on user Apr 14 01:46:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033554 Apr 14 01:46:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 139/415] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=5 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=9 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:58 user devstack@n-api.service[61836]: DEBUG nova.objects.instance [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'flavor' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=61836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:46:58 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa/action" status: 200 len: 32 microversion: 2.1 time: 0.106453 Apr 14 01:46:58 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 141/416] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:46:58 2023] POST /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa/action => generated 32 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=7 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:59 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:46:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e6e43c60-911f-4a02-a9a7-537d816c4276 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa" status: 200 len: 1510 microversion: 2.1 time: 0.264832 Apr 14 01:46:59 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 137/417] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:46:58 2023] GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:46:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:46:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "name": "network-vif-unplugged", "status": "completed", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:46:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:46:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:46:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:46:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] Creating event network-vif-unplugged:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 01:46:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047261 Apr 14 01:46:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 140/418] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:46:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:01 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "name": "network-vif-plugged", "status": "completed", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:01 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] Creating event network-vif-plugged:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 01:47:01 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028058 Apr 14 01:47:01 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 142/419] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "name": "network-vif-plugged", "status": "completed", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}, {"server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "name": "network-vif-plugged", "status": "completed", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Creating event network-vif-plugged:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 01:47:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Creating event network-vif-plugged:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 01:47:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038520 Apr 14 01:47:03 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 138/420] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:05 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d0c35b40-8801-42fd-98b7-83625e9f6e79 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60" status: 200 len: 2824 microversion: 2.42 time: 0.222319 Apr 14 01:47:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 141/421] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:47:05 2023] GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 => generated 2824 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:47:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:09 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:09 user devstack@n-api.service[61836]: DEBUG nova.objects.instance [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'services' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=61836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:47:09 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-volume_attachments/7298e05a-b142-4365-95e1-f8551de0ae79" status: 202 len: 0 microversion: 2.1 time: 0.247486 Apr 14 01:47:09 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 143/422] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:47:08 2023] DELETE /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-volume_attachments/7298e05a-b142-4365-95e1-f8551de0ae79 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:47:09 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-c82405b4-d6bd-4f01-af47-d4aaaaa25ae2 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:09 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-c82405b4-d6bd-4f01-af47-d4aaaaa25ae2 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c82405b4-d6bd-4f01-af47-d4aaaaa25ae2 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c82405b4-d6bd-4f01-af47-d4aaaaa25ae2 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c82405b4-d6bd-4f01-af47-d4aaaaa25ae2 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c82405b4-d6bd-4f01-af47-d4aaaaa25ae2 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c82405b4-d6bd-4f01-af47-d4aaaaa25ae2 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c82405b4-d6bd-4f01-af47-d4aaaaa25ae2 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-c82405b4-d6bd-4f01-af47-d4aaaaa25ae2 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059144 Apr 14 01:47:09 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 139/423] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:47:09 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-0060c9fe-c0e2-4e55-ae74-278aaef465e6 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-0060c9fe-c0e2-4e55-ae74-278aaef465e6 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0060c9fe-c0e2-4e55-ae74-278aaef465e6 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0060c9fe-c0e2-4e55-ae74-278aaef465e6 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0060c9fe-c0e2-4e55-ae74-278aaef465e6 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0060c9fe-c0e2-4e55-ae74-278aaef465e6 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0060c9fe-c0e2-4e55-ae74-278aaef465e6 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0060c9fe-c0e2-4e55-ae74-278aaef465e6 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:16 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-0060c9fe-c0e2-4e55-ae74-278aaef465e6 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.090548 Apr 14 01:47:16 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:47:16 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-interface => generated 282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:47:17 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae HTTP/1.1 Apr 14 01:47:17 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:47:17 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:47:17 user devstack@n-api.service[61837]: Connection: close Apr 14 01:47:17 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:47:17 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:47:17 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:47:17 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:47:17 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:47:17 user devstack@n-api.service[61837]: method: > Apr 14 01:47:17 user devstack@n-api.service[61837]: exception: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: action_args: {'id': '5803c8ed-f1fe-47ae-aaba-13b7cd8831ae'} Apr 14 01:47:17 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:47:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-901f10cc-6a79-40b2-afb8-b2adc590238b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" status: 404 len: 111 microversion: 2.1 time: 0.037466 Apr 14 01:47:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 140/425] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:17 2023] GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] HTTP exception thrown: Instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb could not be found. Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Request method failure captured: Apr 14 01:47:17 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb HTTP/1.1 Apr 14 01:47:17 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:47:17 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:47:17 user devstack@n-api.service[61836]: Connection: close Apr 14 01:47:17 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:47:17 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:47:17 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:47:17 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:47:17 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK9baGzH-xpi9G17flzyH9MAFUyr8Ebhsh1BipH4TPPM7Wi1dYk7oGHdYnL_DT0TM_b4KLST00HtRE9gR33apu3L9RNt7aE0-UUxhLokaO0L9iMc4DN8fS95fEIK4-mtWGLTBBDcc2f7KygsomEwKj9ddNmzXLWjFKex-udN27Ej72w Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Project-Id: cdb176ac656c47b38e736fc629fc46e0 Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Project-Name: tempest-VolumesActionsTest-193871514 Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdb176ac656c47b38e736fc629fc46e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cdb176ac656c47b38e736fc629fc46e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cdb176ac656c47b38e736fc629fc46e0"}]}] Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Tenant: tempest-VolumesActionsTest-193871514 Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Tenant-Id: cdb176ac656c47b38e736fc629fc46e0 Apr 14 01:47:17 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-VolumesActionsTest-193871514 Apr 14 01:47:17 user devstack@n-api.service[61836]: X-User: tempest-VolumesActionsTest-193871514-project-member Apr 14 01:47:17 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:47:17 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:47:17 user devstack@n-api.service[61836]: X-User-Id: 8b18b911fcf847efbf4f814f3b687279 Apr 14 01:47:17 user devstack@n-api.service[61836]: X-User-Name: tempest-VolumesActionsTest-193871514-project-member Apr 14 01:47:17 user devstack@n-api.service[61836]: method: > Apr 14 01:47:17 user devstack@n-api.service[61836]: exception: Instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb could not be found. Apr 14 01:47:17 user devstack@n-api.service[61836]: action_args: {'id': 'd579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb'} Apr 14 01:47:17 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb could not be found. Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb could not be found. Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb could not be found. Apr 14 01:47:17 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Returning 404 to user: Instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:47:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-87eb6255-94a2-41fe-97a4-677db02eeaf5 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" status: 404 len: 111 microversion: 2.1 time: 0.135681 Apr 14 01:47:17 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 144/426] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:16 2023] GET /compute/v2.1/servers/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:47:17 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae HTTP/1.1 Apr 14 01:47:17 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:47:17 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:47:17 user devstack@n-api.service[61835]: Connection: close Apr 14 01:47:17 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:47:17 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:47:17 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:47:17 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:47:17 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:47:17 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:47:17 user devstack@n-api.service[61835]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:47:17 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:47:17 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:47:17 user devstack@n-api.service[61835]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:47:17 user devstack@n-api.service[61835]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:47:17 user devstack@n-api.service[61835]: method: > Apr 14 01:47:17 user devstack@n-api.service[61835]: exception: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61835]: action_args: {'id': '5803c8ed-f1fe-47ae-aaba-13b7cd8831ae'} Apr 14 01:47:17 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:47:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-3f63271d-6d5b-4430-8eb5-43ea7b32ae6b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" status: 404 len: 111 microversion: 2.1 time: 0.045813 Apr 14 01:47:17 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 143/427] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:47:17 2023] DELETE /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:47:17 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae HTTP/1.1 Apr 14 01:47:17 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:47:17 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:47:17 user devstack@n-api.service[61837]: Connection: close Apr 14 01:47:17 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:47:17 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:47:17 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:47:17 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:47:17 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:47:17 user devstack@n-api.service[61837]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:47:17 user devstack@n-api.service[61837]: method: > Apr 14 01:47:17 user devstack@n-api.service[61837]: exception: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: action_args: {'id': '5803c8ed-f1fe-47ae-aaba-13b7cd8831ae'} Apr 14 01:47:17 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. Apr 14 01:47:17 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:47:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-7438dc79-a23d-44fe-8130-e5e64b8251cd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" status: 404 len: 111 microversion: 2.1 time: 0.046324 Apr 14 01:47:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 141/428] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:17 2023] GET /compute/v2.1/servers/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:17 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-3ba8ff1a-280e-491f-8929-edad038900d4 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a" status: 200 len: 1494 microversion: 2.1 time: 0.156233 Apr 14 01:47:17 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 145/429] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:17 2023] GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a => generated 1494 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:47:18 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:18 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] Creating event network-changed:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:47:18 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034607 Apr 14 01:47:18 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 144/430] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:18 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:18 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:18 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:18 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-a5dcde54-2934-4ace-bb97-7fbf79edcc51 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1538 microversion: 2.1 time: 0.269815 Apr 14 01:47:18 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 142/431] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:18 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1538 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:47:18 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:18 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:18 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:18 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-2f7ce9ca-399d-4f3e-bf83-90140bcaec4c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1538 microversion: 2.1 time: 0.156784 Apr 14 01:47:18 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 146/432] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:18 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1538 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-305851277", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "f9cb54ed-9520-43e9-a1c8-2be10b7f955e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "74c65fc2-ff90-46a4-a5e1-300009f92343"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] validate_networks() for [('74c65fc2-ff90-46a4-a5e1-300009f92343', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for user 50e3354ac1a84c59a7dee8e1ae6e771a and project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:47:25 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9cb54ed-9520-43e9-a1c8-2be10b7f955e',volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:47:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.619598 Apr 14 01:47:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 145/433] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:47:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:47:26 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-00a46edd-651e-4231-abdd-5effbd516af0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:26 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-00a46edd-651e-4231-abdd-5effbd516af0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:26 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:26 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-00a46edd-651e-4231-abdd-5effbd516af0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:26 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-00a46edd-651e-4231-abdd-5effbd516af0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28" status: 200 len: 1065 microversion: 2.1 time: 0.062840 Apr 14 01:47:26 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 143/434] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:26 2023] GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 => generated 1065 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:47:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c/action" status: 202 len: 0 microversion: 2.87 time: 0.072715 Apr 14 01:47:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 147/435] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 01:47:26 2023] POST /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:26 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-909dbc76-ee27-4a70-be7f-4e64b25faada tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c" status: 200 len: 1763 microversion: 2.87 time: 0.211563 Apr 14 01:47:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 146/436] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:47:26 2023] GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c => generated 1763 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:47:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-unplugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] Creating event network-vif-unplugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:47:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038429 Apr 14 01:47:27 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 144/437] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:29 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-plugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:29 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=15 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:29 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] Creating event network-vif-plugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:47:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038156 Apr 14 01:47:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 148/438] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ccf53b5-9199-4812-a635-4f4f22fb5d28", "tag": "d58d1594-1a97-4a63-be67-e8101e889654"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] Creating event network-changed:d58d1594-1a97-4a63-be67-e8101e889654 for instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 on user Apr 14 01:47:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038532 Apr 14 01:47:29 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 147/439] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:31 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-plugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}, {"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-plugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:31 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=19 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:31 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=27 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:31 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Creating event network-vif-plugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:47:31 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Creating event network-vif-plugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:47:31 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038625 Apr 14 01:47:31 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 145/440] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:36 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:36 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e25e45353e40b9a8bb14736c03fdeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740488dbb5114fb2b38be20f8ce4adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d3109c04-5f6c-4cb1-9c92-85c74e1d2d70 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800" status: 200 len: 1565 microversion: 2.1 time: 0.156173 Apr 14 01:47:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 149/441] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:36 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:37 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] HTTP exception thrown: Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 could not be found. Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Request method failure captured: Apr 14 01:47:37 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59 HTTP/1.1 Apr 14 01:47:37 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:47:37 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:47:37 user devstack@n-api.service[61835]: Connection: close Apr 14 01:47:37 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:47:37 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:47:37 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:47:37 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:47:37 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8XYWnI5EskdN7Hi6phikXNwf0Lukb1lklhlvmZhLFI7VQfLB_U2cZBqznIbEODElrTYdk87x-3Ck7LfQaNFj57RL1UeEIzHW26HzNXDXPZsERWydj-sIX-KhMd5zBg80Sou-OPUO6MFpYHVvQLumJO3q4tLkDpQ0xdqcmbGdWdS2g Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Project-Id: d0a409270d6d4d408de33c5e71a56da9 Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesAdminNegativeTest-1981219566 Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0a409270d6d4d408de33c5e71a56da9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d0a409270d6d4d408de33c5e71a56da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d0a409270d6d4d408de33c5e71a56da9"}]}] Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesAdminNegativeTest-1981219566 Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Tenant-Id: d0a409270d6d4d408de33c5e71a56da9 Apr 14 01:47:37 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1981219566 Apr 14 01:47:37 user devstack@n-api.service[61835]: X-User: tempest-VolumesAdminNegativeTest-1981219566-project-member Apr 14 01:47:37 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:47:37 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:47:37 user devstack@n-api.service[61835]: X-User-Id: bbaf843e44ff4359a15ab6d625134b07 Apr 14 01:47:37 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesAdminNegativeTest-1981219566-project-member Apr 14 01:47:37 user devstack@n-api.service[61835]: method: > Apr 14 01:47:37 user devstack@n-api.service[61835]: exception: Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 could not be found. Apr 14 01:47:37 user devstack@n-api.service[61835]: action_args: {'id': 'f68784e7-578c-4a12-87d4-f35fbc5a1d59'} Apr 14 01:47:37 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 could not be found. Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 could not be found. Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 could not be found. Apr 14 01:47:37 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:47:37 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Returning 404 to user: Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:47:37 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-80a3c580-8285-4258-8858-310c5e0ebc12 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59" status: 404 len: 111 microversion: 2.1 time: 0.033990 Apr 14 01:47:37 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 148/442] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:37 2023] GET /compute/v2.1/servers/f68784e7-578c-4a12-87d4-f35fbc5a1d59 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:47:37 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-500eb94d-dc04-4bf0-99c8-0edc4967f5f7 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Calling method '.version_select at 0x7fd4210b0b80>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:37 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-500eb94d-dc04-4bf0-99c8-0edc4967f5f7 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858701247" status: 202 len: 0 microversion: 2.1 time: 0.031617 Apr 14 01:47:37 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 146/443] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 01:47:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858701247 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:47:37 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ccf53b5-9199-4812-a635-4f4f22fb5d28", "name": "network-vif-plugged", "status": "completed", "tag": "d58d1594-1a97-4a63-be67-e8101e889654"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:37 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] Creating event network-vif-plugged:d58d1594-1a97-4a63-be67-e8101e889654 for instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 on user Apr 14 01:47:37 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057205 Apr 14 01:47:37 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 150/444] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:39 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ccf53b5-9199-4812-a635-4f4f22fb5d28", "name": "network-vif-plugged", "status": "completed", "tag": "d58d1594-1a97-4a63-be67-e8101e889654"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] Creating event network-vif-plugged:d58d1594-1a97-4a63-be67-e8101e889654 for instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 on user Apr 14 01:47:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039882 Apr 14 01:47:39 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 149/445] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:41 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] Creating event network-changed:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:47:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033991 Apr 14 01:47:41 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 147/446] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64fbddc5-4def-42b8-8084-284892fa8b62"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "POST /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335277 Apr 14 01:47:42 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 151/447] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:47:41 2023] POST /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:45 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:45 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:45 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] Creating event network-changed:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:47:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031596 Apr 14 01:47:45 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 148/448] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:45 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:47:45 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 204 len: 0 microversion: 2.1 time: 0.150820 Apr 14 01:47:45 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 150/449] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:47:45 2023] DELETE /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:47:45 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:45 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:45 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '447da297b18f4e7f86fa94cd4d5d7918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef081a56d11d4b4d82ba5fe6572f3b95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:45 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-2ead6b52-721b-429b-a62a-96dd432245d1 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 200 len: 1558 microversion: 2.1 time: 0.209156 Apr 14 01:47:45 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:45 2023] GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:47:45 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-unplugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] Creating event network-vif-unplugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:47:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030747 Apr 14 01:47:45 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 149/451] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:47 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-08f452fb-ccdc-425f-b1e8-d3d55fe31025 req-7ad1c449-41ff-4f05-a002-162dc86235b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-deleted", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:47 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-08f452fb-ccdc-425f-b1e8-d3d55fe31025 req-7ad1c449-41ff-4f05-a002-162dc86235b7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-08f452fb-ccdc-425f-b1e8-d3d55fe31025 req-7ad1c449-41ff-4f05-a002-162dc86235b7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-08f452fb-ccdc-425f-b1e8-d3d55fe31025 req-7ad1c449-41ff-4f05-a002-162dc86235b7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:47 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:47 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-08f452fb-ccdc-425f-b1e8-d3d55fe31025 req-7ad1c449-41ff-4f05-a002-162dc86235b7 service nova] Creating event network-vif-deleted:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:47:47 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-08f452fb-ccdc-425f-b1e8-d3d55fe31025 req-7ad1c449-41ff-4f05-a002-162dc86235b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058128 Apr 14 01:47:47 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 151/452] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:47 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee4cf01f-8d33-4696-b6ec-7f188ee18026", "name": "network-vif-plugged", "status": "completed", "tag": "9b10b56a-df5a-429e-a551-db729007648a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] Creating event network-vif-plugged:9b10b56a-df5a-429e-a551-db729007648a for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 on user Apr 14 01:47:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032432 Apr 14 01:47:47 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 153/453] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:47:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:47:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-c5b2d247-f867-4947-87ab-16d25fc22a64 tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Action: 'create', calling method: .version_select at 0x7fd420f97d90>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-636637609", "metadata": {"Type": "work"}}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:47:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:49 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:49 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:47:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-da6e122f-8e3a-4a68-97d8-0cf5b12d0d0f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa" status: 200 len: 1490 microversion: 2.1 time: 0.167049 Apr 14 01:47:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 152/454] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:47:49 2023] GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa => generated 1490 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 01:47:49 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-c5b2d247-f867-4947-87ab-16d25fc22a64 tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.671472 Apr 14 01:47:49 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 150/455] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 01:47:48 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 673 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 01:47:49 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-db11dd13-7f0d-489d-87fa-0be2e623d82c tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Calling method '.version_select at 0x7fd420fbb010>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-db11dd13-7f0d-489d-87fa-0be2e623d82c tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103" status: 200 len: 352 microversion: 2.1 time: 0.062596 Apr 14 01:47:49 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 154/456] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:47:49 2023] GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:50 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-332baf67-1a63-414a-ae66-2360c85a463a tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Calling method '.version_select at 0x7fd4210bb640>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:50 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-332baf67-1a63-414a-ae66-2360c85a463a tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103" status: 200 len: 352 microversion: 2.1 time: 0.066489 Apr 14 01:47:50 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 153/457] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:47:50 2023] GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:51 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-c834ae1c-f79d-4349-8c90-edab47fb7c2c tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Calling method '.version_select at 0x7fd420e3e290>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-c834ae1c-f79d-4349-8c90-edab47fb7c2c tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103" status: 200 len: 353 microversion: 2.1 time: 0.095901 Apr 14 01:47:51 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 151/458] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:47:51 2023] GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:51 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3522d65c-5da2-45ef-a2f2-a311cd9bf2f7 tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Calling method '.version_select at 0x7fd420e244c0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-3522d65c-5da2-45ef-a2f2-a311cd9bf2f7 tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103" status: 200 len: 353 microversion: 2.1 time: 0.069909 Apr 14 01:47:51 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 155/459] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:47:51 2023] GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:51 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-14253f03-2bb1-4813-a0a1-8a252e85e74c tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Calling method '.version_select at 0x7fd420e2b5b0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:51 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-14253f03-2bb1-4813-a0a1-8a252e85e74c tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103" status: 202 len: 0 microversion: 2.1 time: 0.076997 Apr 14 01:47:51 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 154/460] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 01:47:51 2023] DELETE /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:47:51 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-03969556-05c3-4f52-a0e4-3c73d48dbb20 tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Calling method '.version_select at 0x7fd421136b90>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-03969556-05c3-4f52-a0e4-3c73d48dbb20 tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103" status: 200 len: 352 microversion: 2.1 time: 0.074262 Apr 14 01:47:51 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 152/461] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:47:51 2023] GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 => generated 352 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:52 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-38e48370-ae6f-45f3-a551-3875b1ac179f tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Calling method '.version_select at 0x7fd420e27250>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:52 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-38e48370-ae6f-45f3-a551-3875b1ac179f tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103" status: 200 len: 352 microversion: 2.1 time: 0.059007 Apr 14 01:47:52 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 156/462] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:47:52 2023] GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:53 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4aa6f19f-6d47-469c-940b-97b6856b6aae tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Calling method '.version_select at 0x7fd4210bb250>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:54 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-4aa6f19f-6d47-469c-940b-97b6856b6aae tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103" status: 200 len: 352 microversion: 2.1 time: 0.060796 Apr 14 01:47:54 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 155/463] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:47:53 2023] GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:47:55 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-065ce8cf-b5c1-4564-834d-98a3f0e9e34e tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Calling method '.version_select at 0x7fd420f977f0>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:55 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-065ce8cf-b5c1-4564-834d-98a3f0e9e34e tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] HTTP exception thrown: Volume 03b1d79c-7368-42b7-a7d9-ec20888c0103 could not be found. Apr 14 01:47:55 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-065ce8cf-b5c1-4564-834d-98a3f0e9e34e tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Request method failure captured: Apr 14 01:47:55 user devstack@n-api.service[61837]: request: GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 HTTP/1.1 Apr 14 01:47:55 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:47:55 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:47:55 user devstack@n-api.service[61837]: Connection: close Apr 14 01:47:55 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:47:55 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:47:55 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:47:55 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:47:55 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLDEAQWi8LQv--0ZyPk7ihgjxX9zxogMJdkkHy_dw6USwYjL-IHP-xyropcrzBLoEtDNx3huwoCh4w1ksfK_6Ev1Hrh7DDZCOmO6nSk7nTfUKdSqkLwCOW5yplJtaq1yoft5Vpf73kRJ9cJGp1d-j1UJod0gd7n-ME1OUXjQrfvgrA0 Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Project-Id: 94252b8938d44d0eaeabca79d6dca0cd Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Project-Name: tempest-VolumesGetTestJSON-1546803663 Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94252b8938d44d0eaeabca79d6dca0cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94252b8938d44d0eaeabca79d6dca0cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94252b8938d44d0eaeabca79d6dca0cd"}]}] Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Tenant: tempest-VolumesGetTestJSON-1546803663 Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Tenant-Id: 94252b8938d44d0eaeabca79d6dca0cd Apr 14 01:47:55 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-VolumesGetTestJSON-1546803663 Apr 14 01:47:55 user devstack@n-api.service[61837]: X-User: tempest-VolumesGetTestJSON-1546803663-project-member Apr 14 01:47:55 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:47:55 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:47:55 user devstack@n-api.service[61837]: X-User-Id: bb2025c1b16945ebb98b0cc645d88877 Apr 14 01:47:55 user devstack@n-api.service[61837]: X-User-Name: tempest-VolumesGetTestJSON-1546803663-project-member Apr 14 01:47:55 user devstack@n-api.service[61837]: method: Apr 14 01:47:55 user devstack@n-api.service[61837]: exception: Volume 03b1d79c-7368-42b7-a7d9-ec20888c0103 could not be found. Apr 14 01:47:55 user devstack@n-api.service[61837]: action_args: {'id': '03b1d79c-7368-42b7-a7d9-ec20888c0103'} Apr 14 01:47:55 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03b1d79c-7368-42b7-a7d9-ec20888c0103 could not be found. (HTTP 404) (Request-ID: req-7277d4ab-a2c8-4898-b6a6-0444cde9f70b) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03b1d79c-7368-42b7-a7d9-ec20888c0103 could not be found. Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03b1d79c-7368-42b7-a7d9-ec20888c0103 could not be found. Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03b1d79c-7368-42b7-a7d9-ec20888c0103 could not be found. Apr 14 01:47:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:47:55 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-065ce8cf-b5c1-4564-834d-98a3f0e9e34e tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] Returning 404 to user: Volume 03b1d79c-7368-42b7-a7d9-ec20888c0103 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:47:55 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-065ce8cf-b5c1-4564-834d-98a3f0e9e34e tempest-VolumesGetTestJSON-1546803663 tempest-VolumesGetTestJSON-1546803663-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103" status: 404 len: 109 microversion: 2.1 time: 0.038879 Apr 14 01:47:55 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 153/464] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 01:47:55 2023] GET /compute/v2.1/os-volumes/03b1d79c-7368-42b7-a7d9-ec20888c0103 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=11 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e9aa9174-5bcc-4b5c-ae20-cd7749a60618 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-e9aa9174-5bcc-4b5c-ae20-cd7749a60618 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=7 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9aa9174-5bcc-4b5c-ae20-cd7749a60618 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9aa9174-5bcc-4b5c-ae20-cd7749a60618 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9aa9174-5bcc-4b5c-ae20-cd7749a60618 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9aa9174-5bcc-4b5c-ae20-cd7749a60618 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9aa9174-5bcc-4b5c-ae20-cd7749a60618 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:59 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9aa9174-5bcc-4b5c-ae20-cd7749a60618 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:59 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e9aa9174-5bcc-4b5c-ae20-cd7749a60618 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051917 Apr 14 01:47:59 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 157/465] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:47:59 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:47:59 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'services' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:47:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments/64fbddc5-4def-42b8-8084-284892fa8b62" status: 202 len: 0 microversion: 2.1 time: 0.217295 Apr 14 01:47:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 156/466] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:47:59 2023] DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments/64fbddc5-4def-42b8-8084-284892fa8b62 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=7 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-104b555a-6048-4094-bbfa-749ce41d26d2 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-104b555a-6048-4094-bbfa-749ce41d26d2 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-104b555a-6048-4094-bbfa-749ce41d26d2 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-104b555a-6048-4094-bbfa-749ce41d26d2 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-104b555a-6048-4094-bbfa-749ce41d26d2 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-104b555a-6048-4094-bbfa-749ce41d26d2 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-104b555a-6048-4094-bbfa-749ce41d26d2 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:47:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-104b555a-6048-4094-bbfa-749ce41d26d2 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:47:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-104b555a-6048-4094-bbfa-749ce41d26d2 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050800 Apr 14 01:47:59 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 154/467] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:47:59 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:02 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e218d74f-e0de-4826-a74d-93b58699a88b tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '.version_select at 0x7fd420e24700>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:03 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e218d74f-e0de-4826-a74d-93b58699a88b tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/0abe5ca9-f8b7-4782-9d51-b632ce789e86" status: 204 len: 0 microversion: 2.1 time: 0.239809 Apr 14 01:48:03 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 158/468] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:48:02 2023] DELETE /compute/v2.1/images/0abe5ca9-f8b7-4782-9d51-b632ce789e86 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:48:03 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:03 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:03 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:48:03 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07" status: 204 len: 0 microversion: 2.1 time: 0.199892 Apr 14 01:48:03 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 157/469] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:48:03 2023] DELETE /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:48:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:03 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:03 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09ab986a00f43b384cf5d517857a13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4833ddea1fa74866b97ef52a730605aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3469d736-5be1-4a09-9d16-0a890e551178 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07" status: 200 len: 1677 microversion: 2.1 time: 0.162117 Apr 14 01:48:03 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 155/470] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:48:03 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:48:03 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-unplugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:03 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] Creating event network-vif-unplugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:48:03 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027983 Apr 14 01:48:03 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 159/471] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-736edba7-42af-43de-8c3d-807b18a99101 req-e60d38fe-07e8-4c4d-982f-ca49a05a074c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-deleted", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-736edba7-42af-43de-8c3d-807b18a99101 req-e60d38fe-07e8-4c4d-982f-ca49a05a074c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-736edba7-42af-43de-8c3d-807b18a99101 req-e60d38fe-07e8-4c4d-982f-ca49a05a074c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-736edba7-42af-43de-8c3d-807b18a99101 req-e60d38fe-07e8-4c4d-982f-ca49a05a074c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-736edba7-42af-43de-8c3d-807b18a99101 req-e60d38fe-07e8-4c4d-982f-ca49a05a074c service nova] Creating event network-vif-deleted:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:48:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-736edba7-42af-43de-8c3d-807b18a99101 req-e60d38fe-07e8-4c4d-982f-ca49a05a074c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035403 Apr 14 01:48:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 158/472] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3fb53f-7b4a-48d3-85ab-418bad435c07", "name": "network-vif-plugged", "status": "completed", "tag": "7942720d-0958-4826-bedf-0a7eebfe45b6"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-7988f12b-6f2c-438d-b4ff-5bc3f0f34bf9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:05 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-7988f12b-6f2c-438d-b4ff-5bc3f0f34bf9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] Creating event network-vif-plugged:7942720d-0958-4826-bedf-0a7eebfe45b6 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 on user Apr 14 01:48:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Apr 14 01:48:05 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 156/473] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7988f12b-6f2c-438d-b4ff-5bc3f0f34bf9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7988f12b-6f2c-438d-b4ff-5bc3f0f34bf9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7988f12b-6f2c-438d-b4ff-5bc3f0f34bf9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7988f12b-6f2c-438d-b4ff-5bc3f0f34bf9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7988f12b-6f2c-438d-b4ff-5bc3f0f34bf9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7988f12b-6f2c-438d-b4ff-5bc3f0f34bf9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-7988f12b-6f2c-438d-b4ff-5bc3f0f34bf9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.169683 Apr 14 01:48:05 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 160/474] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 01:48:05 2023] GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60/os-interface => generated 1828 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:06 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:06 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2c3eea8d-5b70-459e-b8d5-60f54303d73e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60" status: 200 len: 2824 microversion: 2.42 time: 0.258396 Apr 14 01:48:06 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 159/475] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:48:06 2023] GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 => generated 2824 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:48:06 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-06979f9c-db3e-46a6-950a-335e87d86e6f tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:06 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-06979f9c-db3e-46a6-950a-335e87d86e6f tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06979f9c-db3e-46a6-950a-335e87d86e6f tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06979f9c-db3e-46a6-950a-335e87d86e6f tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06979f9c-db3e-46a6-950a-335e87d86e6f tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06979f9c-db3e-46a6-950a-335e87d86e6f tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06979f9c-db3e-46a6-950a-335e87d86e6f tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06979f9c-db3e-46a6-950a-335e87d86e6f tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:07 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-06979f9c-db3e-46a6-950a-335e87d86e6f tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.126580 Apr 14 01:48:07 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 157/476] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 01:48:06 2023] GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60/os-interface => generated 1828 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:48:07 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "tag": "0912c834-ed73-4f3a-9419-2c08d6094b93"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] Creating event network-changed:0912c834-ed73-4f3a-9419-2c08d6094b93 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031126 Apr 14 01:48:07 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 161/477] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:48:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60" status: 204 len: 0 microversion: 2.42 time: 0.120648 Apr 14 01:48:08 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 160/478] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:48:08 2023] DELETE /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-5365e897-8793-4407-a6e8-7ad41ffe0c4e tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60" status: 200 len: 2830 microversion: 2.42 time: 0.284289 Apr 14 01:48:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 158/479] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:48:08 2023] GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 => generated 2830 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:48:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-unplugged", "status": "completed", "tag": "0912c834-ed73-4f3a-9419-2c08d6094b93"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] Creating event network-vif-unplugged:0912c834-ed73-4f3a-9419-2c08d6094b93 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038289 Apr 14 01:48:08 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 162/480] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-unplugged", "status": "completed", "tag": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] Creating event network-vif-unplugged:b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041929 Apr 14 01:48:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 159/481] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:09 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:09 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-16018caa-d660-497d-baa3-0878634acc3e tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1656 microversion: 2.1 time: 0.306752 Apr 14 01:48:09 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 161/482] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:48:08 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1656 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:48:09 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:09 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:09 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-unplugged", "status": "completed", "tag": "4e9a3669-2ccb-49fc-a153-dfcee715ad41"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "4e9a3669-2ccb-49fc-a153-dfcee715ad41"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-unplugged", "status": "completed", "tag": "6517ba71-e7ec-4e68-8860-714bb4711368"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Creating event network-vif-unplugged:4e9a3669-2ccb-49fc-a153-dfcee715ad41 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Creating event network-vif-plugged:4e9a3669-2ccb-49fc-a153-dfcee715ad41 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Creating event network-vif-unplugged:6517ba71-e7ec-4e68-8860-714bb4711368 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.041092 Apr 14 01:48:09 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 160/483] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:09 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:09 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:09 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-229392cc-5242-4082-9723-2141bd2189c0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1656 microversion: 2.1 time: 0.865463 Apr 14 01:48:09 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 163/484] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:48:09 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1656 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:48:10 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "0912c834-ed73-4f3a-9419-2c08d6094b93"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-unplugged", "status": "completed", "tag": "6532dff7-2168-407f-be9b-bdbea1b6edd4"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "6532dff7-2168-407f-be9b-bdbea1b6edd4"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-unplugged", "status": "completed", "tag": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:10 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:10 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:10 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Creating event network-vif-plugged:0912c834-ed73-4f3a-9419-2c08d6094b93 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Creating event network-vif-unplugged:6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Creating event network-vif-plugged:6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Creating event network-vif-unplugged:9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Creating event network-vif-plugged:9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.040483 Apr 14 01:48:10 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 162/485] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:10 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:10 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-unplugged", "status": "completed", "tag": "f12d4d92-cf6a-4908-a203-d32ad80cb617"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "f12d4d92-cf6a-4908-a203-d32ad80cb617"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Creating event network-vif-plugged:b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Creating event network-vif-unplugged:f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Creating event network-vif-plugged:f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.047808 Apr 14 01:48:10 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 161/486] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:10 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:11 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-plugged", "status": "completed", "tag": "6517ba71-e7ec-4e68-8860-714bb4711368"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] Creating event network-vif-plugged:6517ba71-e7ec-4e68-8860-714bb4711368 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030527 Apr 14 01:48:11 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 164/487] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:13 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-deleted", "tag": "6532dff7-2168-407f-be9b-bdbea1b6edd4"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] Creating event network-vif-deleted:6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033792 Apr 14 01:48:13 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 163/488] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-deleted", "tag": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-deleted", "tag": "6517ba71-e7ec-4e68-8860-714bb4711368"}, {"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-deleted", "tag": "f12d4d92-cf6a-4908-a203-d32ad80cb617"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] Creating event network-vif-deleted:9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] Creating event network-vif-deleted:6517ba71-e7ec-4e68-8860-714bb4711368 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] Creating event network-vif-deleted:f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032356 Apr 14 01:48:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 162/489] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:15 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:16 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:16 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:16 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-81d967ff-a412-4215-8398-130f32f1803d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28" status: 200 len: 1392 microversion: 2.1 time: 0.168188 Apr 14 01:48:16 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 165/490] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:48:16 2023] GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:16 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:16 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-4c79fce4-8c99-4286-8c22-465da4be0919 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c" status: 200 len: 1769 microversion: 2.87 time: 0.220160 Apr 14 01:48:16 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 164/491] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:48:16 2023] GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c => generated 1769 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:48:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-38bafb60-8400-4211-b0d6-8f305b2bd90f req-bdf7cea2-3db5-4b4e-ae23-70f8d05e198e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8101aa-2078-4f0e-becb-62636c747c60", "name": "network-vif-deleted", "tag": "0912c834-ed73-4f3a-9419-2c08d6094b93"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-38bafb60-8400-4211-b0d6-8f305b2bd90f req-bdf7cea2-3db5-4b4e-ae23-70f8d05e198e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-38bafb60-8400-4211-b0d6-8f305b2bd90f req-bdf7cea2-3db5-4b4e-ae23-70f8d05e198e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-38bafb60-8400-4211-b0d6-8f305b2bd90f req-bdf7cea2-3db5-4b4e-ae23-70f8d05e198e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-38bafb60-8400-4211-b0d6-8f305b2bd90f req-bdf7cea2-3db5-4b4e-ae23-70f8d05e198e service nova] Creating event network-vif-deleted:0912c834-ed73-4f3a-9419-2c08d6094b93 for instance 4f8101aa-2078-4f0e-becb-62636c747c60 on user Apr 14 01:48:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-38bafb60-8400-4211-b0d6-8f305b2bd90f req-bdf7cea2-3db5-4b4e-ae23-70f8d05e198e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035105 Apr 14 01:48:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 163/492] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:48:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e9acebc6-28fa-40aa-815a-6f6aa188128f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-937493043", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "destination_type": "local"}, {"source_type": "volume", "uuid": "5c9a8475-2b28-4660-8c4a-197d3b9b2334", "destination_type": "invalid"}], "networks": [{"uuid": "93155729-11d3-4eff-bbd2-8860a881e233"}]}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e9acebc6-28fa-40aa-815a-6f6aa188128f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Request method failure captured: Apr 14 01:48:20 user devstack@n-api.service[61836]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 01:48:20 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:48:20 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:48:20 user devstack@n-api.service[61836]: Connection: close Apr 14 01:48:20 user devstack@n-api.service[61836]: Content-Length: 493 Apr 14 01:48:20 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:48:20 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:48:20 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:48:20 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8XOBsViHuKnHybsXrnQtd_ZJfWj5td05sTbzyiyyn1p8E4CmU9bRusRq99zpd0ETs3wMxsQHcOPYlhDm9qUPTkcGZcTosn0Mo4H3s8_XVoaK3ZA0pMsmloQ8yPZWr5o14A4PeHmRr16oUPZFV3YcuMrZvWpfF9fHy9Ln_BnWQRPEc Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Project-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Project-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}] Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Tenant: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Tenant-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:48:20 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:48:20 user devstack@n-api.service[61836]: X-User: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:48:20 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:48:20 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:48:20 user devstack@n-api.service[61836]: X-User-Id: 236828e284154097a25f59eaedf47c29 Apr 14 01:48:20 user devstack@n-api.service[61836]: X-User-Name: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:48:20 user devstack@n-api.service[61836]: Apr 14 01:48:20 user devstack@n-api.service[61836]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-937493043", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "destination_type": "local"}, {"source_type": "volume", "uuid": "5c9a8475-2b28-4660-8c4a-197d3b9b2334", "destination_type": "invalid"}], "networks": [{"uuid": "93155729-11d3-4eff-bbd2-8860a881e233"}]}} Apr 14 01:48:20 user devstack@n-api.service[61836]: method: > Apr 14 01:48:20 user devstack@n-api.service[61836]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 01:48:20 user devstack@n-api.service[61836]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-937493043', 'imageRef': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '5c9a8475-2b28-4660-8c4a-197d3b9b2334', 'destination_type': 'invalid'}], 'networks': [{'uuid': '93155729-11d3-4eff-bbd2-8860a881e233'}]}}} Apr 14 01:48:20 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise error Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 01:48:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:48:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e9acebc6-28fa-40aa-815a-6f6aa188128f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:48:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e9acebc6-28fa-40aa-815a-6f6aa188128f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010098 Apr 14 01:48:20 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 166/493] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:48:20 2023] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:48:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:20 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:20 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-1633dd69-1dc5-4769-951f-da97f3ee8caf tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a" status: 200 len: 1494 microversion: 2.1 time: 0.169329 Apr 14 01:48:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 165/494] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:48:20 2023] GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a => generated 1494 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=20 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=34 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] HTTP exception thrown: Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 could not be found. Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Request method failure captured: Apr 14 01:48:35 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 HTTP/1.1 Apr 14 01:48:35 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:48:35 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:48:35 user devstack@n-api.service[61837]: Connection: close Apr 14 01:48:35 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:48:35 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:48:35 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:48:35 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:48:35 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK9iombKgQDvPm41pHcLePXj-9_IFCio2TrvgVYNsTRvzQWo1eiOodRleN6aA2n3yGHgMiQrGIUT5D9_hcEfBY7kgQLV7YtYK_8slp5ex3wsqhHjV0dYHcXur0PyPKx8CsO3WyD6lQ2GyCy92Jr_HmDWUl_9af5wSYpmijpe8gz_-5k Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Project-Id: ef081a56d11d4b4d82ba5fe6572f3b95 Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestShelveInstance-437254779 Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef081a56d11d4b4d82ba5fe6572f3b95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef081a56d11d4b4d82ba5fe6572f3b95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef081a56d11d4b4d82ba5fe6572f3b95"}]}] Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Tenant: tempest-TestShelveInstance-437254779 Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Tenant-Id: ef081a56d11d4b4d82ba5fe6572f3b95 Apr 14 01:48:35 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestShelveInstance-437254779 Apr 14 01:48:35 user devstack@n-api.service[61837]: X-User: tempest-TestShelveInstance-437254779-project-member Apr 14 01:48:35 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:48:35 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:48:35 user devstack@n-api.service[61837]: X-User-Id: 447da297b18f4e7f86fa94cd4d5d7918 Apr 14 01:48:35 user devstack@n-api.service[61837]: X-User-Name: tempest-TestShelveInstance-437254779-project-member Apr 14 01:48:35 user devstack@n-api.service[61837]: method: > Apr 14 01:48:35 user devstack@n-api.service[61837]: exception: Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 could not be found. Apr 14 01:48:35 user devstack@n-api.service[61837]: action_args: {'id': 'ee4cf01f-8d33-4696-b6ec-7f188ee18026'} Apr 14 01:48:35 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 could not be found. Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 could not be found. Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 could not be found. Apr 14 01:48:35 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:48:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Returning 404 to user: Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:48:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-2c6ce30d-e8df-4426-a1d7-5e2099260a80 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026" status: 404 len: 111 microversion: 2.1 time: 0.033136 Apr 14 01:48:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 164/495] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:48:35 2023] GET /compute/v2.1/servers/ee4cf01f-8d33-4696-b6ec-7f188ee18026 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:48:35 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=16 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:35 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=30 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-54d7eb33-e889-4e98-9c50-97936effc82f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Calling method '.version_select at 0x7fd420fb89d0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-54d7eb33-e889-4e98-9c50-97936effc82f tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-711764184" status: 202 len: 0 microversion: 2.1 time: 0.052336 Apr 14 01:48:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 167/496] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 01:48:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-711764184 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:49 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:48:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-4f3f18fd-0594-4b6a-989e-dd5f4c246a23 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc" status: 200 len: 1503 microversion: 2.1 time: 0.153596 Apr 14 01:48:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 166/497] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:48:49 2023] GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-878ba45a-1505-4bfe-b8c5-1fec0713e873 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-878ba45a-1505-4bfe-b8c5-1fec0713e873 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-878ba45a-1505-4bfe-b8c5-1fec0713e873 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-878ba45a-1505-4bfe-b8c5-1fec0713e873 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-878ba45a-1505-4bfe-b8c5-1fec0713e873 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-878ba45a-1505-4bfe-b8c5-1fec0713e873 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-878ba45a-1505-4bfe-b8c5-1fec0713e873 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:49 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-878ba45a-1505-4bfe-b8c5-1fec0713e873 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:49 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-878ba45a-1505-4bfe-b8c5-1fec0713e873 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066773 Apr 14 01:48:49 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 165/498] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:48:49 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:48:53 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:48:53 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e59663b0-f628-4a16-8c39-38b28a9a8530"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:48:53 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:53 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] HTTP exception thrown: Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 could not be found. Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Request method failure captured: Apr 14 01:48:53 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 HTTP/1.1 Apr 14 01:48:53 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:48:53 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:48:53 user devstack@n-api.service[61835]: Connection: close Apr 14 01:48:53 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:48:53 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:48:53 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:48:53 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:48:53 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8cbaaOAmzhaqdf_ECVEFv4fqeuwCmcvpeE51MUxRy-F4Xi0aOlL0Wc8SvhRxCE_7mqBvlqmnlLJXp7qeBTzxb0DJW6QVm74WCGXMuNres_1uSqFgwFZrDnthZOckEE3DSxH_md2SgtT8J9CVTsrJWfWWreuf4Iqw6k9XTgw3VO_LY Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Project-Id: 4833ddea1fa74866b97ef52a730605aa Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServerStableDeviceRescueTest-131403183 Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4833ddea1fa74866b97ef52a730605aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4833ddea1fa74866b97ef52a730605aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4833ddea1fa74866b97ef52a730605aa"}]}] Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Tenant: tempest-ServerStableDeviceRescueTest-131403183 Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Tenant-Id: 4833ddea1fa74866b97ef52a730605aa Apr 14 01:48:53 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-131403183 Apr 14 01:48:53 user devstack@n-api.service[61835]: X-User: tempest-ServerStableDeviceRescueTest-131403183-project-member Apr 14 01:48:53 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:48:53 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:48:53 user devstack@n-api.service[61835]: X-User-Id: f09ab986a00f43b384cf5d517857a13d Apr 14 01:48:53 user devstack@n-api.service[61835]: X-User-Name: tempest-ServerStableDeviceRescueTest-131403183-project-member Apr 14 01:48:53 user devstack@n-api.service[61835]: method: > Apr 14 01:48:53 user devstack@n-api.service[61835]: exception: Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 could not be found. Apr 14 01:48:53 user devstack@n-api.service[61835]: action_args: {'id': '3a3fb53f-7b4a-48d3-85ab-418bad435c07'} Apr 14 01:48:53 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 could not be found. Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 could not be found. Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 could not be found. Apr 14 01:48:53 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:53 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Returning 404 to user: Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:48:53 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-0a129341-b9bd-4039-8965-ef91bb2113b0 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07" status: 404 len: 111 microversion: 2.1 time: 0.037546 Apr 14 01:48:53 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 167/499] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:48:53 2023] GET /compute/v2.1/servers/3a3fb53f-7b4a-48d3-85ab-418bad435c07 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:48:53 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-542204b9-fd69-4134-afb7-d9fa00c2a80f tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Calling method '.version_select at 0x7fd4210b0310>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:53 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-542204b9-fd69-4134-afb7-d9fa00c2a80f tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599380679" status: 202 len: 0 microversion: 2.1 time: 0.029516 Apr 14 01:48:53 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 166/500] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 01:48:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1599380679 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:48:53 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "POST /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298239 Apr 14 01:48:53 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 168/501] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:48:53 2023] POST /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:48:58 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] HTTP exception thrown: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Request method failure captured: Apr 14 01:48:58 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 HTTP/1.1 Apr 14 01:48:58 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:48:58 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:48:58 user devstack@n-api.service[61835]: Connection: close Apr 14 01:48:58 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:48:58 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:48:58 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:48:58 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:48:58 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLBO07-FVq8q34K3wmiWnuGjuaT_Y3dHtVK8V8CUtToaG2Am7gx6cHqFq9znqIsQ4f2Rplr2wVQmbq6e_fVJDNz_RUNX7a9bkiZJ6GSmd0J1jNxp-MnwLcepy9yq4LESKWWDx7KHv7WseuuFOHvwnfecpHoV0s9mL_RdFC-PmC2FUyE Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Project-Id: 7782019f67b04982a58ed5272dc4cbb5 Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-819739955 Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7782019f67b04982a58ed5272dc4cbb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7782019f67b04982a58ed5272dc4cbb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7782019f67b04982a58ed5272dc4cbb5"}]}] Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Tenant: tempest-TaggedBootDevicesTest_v242-819739955 Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Tenant-Id: 7782019f67b04982a58ed5272dc4cbb5 Apr 14 01:48:58 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-819739955 Apr 14 01:48:58 user devstack@n-api.service[61835]: X-User: tempest-TaggedBootDevicesTest_v242-819739955-project-member Apr 14 01:48:58 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:48:58 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:48:58 user devstack@n-api.service[61835]: X-User-Id: c4e5234d2ffe4dc898d22be4bd648c47 Apr 14 01:48:58 user devstack@n-api.service[61835]: X-User-Name: tempest-TaggedBootDevicesTest_v242-819739955-project-member Apr 14 01:48:58 user devstack@n-api.service[61835]: method: > Apr 14 01:48:58 user devstack@n-api.service[61835]: exception: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:48:58 user devstack@n-api.service[61835]: action_args: {'id': '4f8101aa-2078-4f0e-becb-62636c747c60'} Apr 14 01:48:58 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:48:58 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:48:58 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Returning 404 to user: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:48:58 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-63639ccc-0d93-43f9-9317-8b812ec79cc0 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60" status: 404 len: 111 microversion: 2.42 time: 0.036954 Apr 14 01:48:58 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 168/502] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:48:58 2023] GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:48:58 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ab7440b1-23d3-4f7c-a47a-7b9631e24322 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '.version_select at 0x7fd420f96950>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:48:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ab7440b1-23d3-4f7c-a47a-7b9631e24322 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639753774" status: 204 len: 0 microversion: 2.42 time: 0.021947 Apr 14 01:48:58 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 167/503] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 01:48:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639753774 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:49:01 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:01 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:01 user devstack@n-api.service[61836]: DEBUG nova.objects.instance [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'services' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=61836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:49:02 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments/e59663b0-f628-4a16-8c39-38b28a9a8530" status: 202 len: 0 microversion: 2.1 time: 0.199433 Apr 14 01:49:02 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 169/504] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:49:01 2023] DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments/e59663b0-f628-4a16-8c39-38b28a9a8530 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:49:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-0e2084cc-1870-4104-b150-50e7d2edadd1 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:02 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-0e2084cc-1870-4104-b150-50e7d2edadd1 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e2084cc-1870-4104-b150-50e7d2edadd1 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e2084cc-1870-4104-b150-50e7d2edadd1 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e2084cc-1870-4104-b150-50e7d2edadd1 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e2084cc-1870-4104-b150-50e7d2edadd1 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e2084cc-1870-4104-b150-50e7d2edadd1 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e2084cc-1870-4104-b150-50e7d2edadd1 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-0e2084cc-1870-4104-b150-50e7d2edadd1 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064588 Apr 14 01:49:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 169/505] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:49:02 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] HTTP exception thrown: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Request method failure captured: Apr 14 01:49:03 user devstack@n-api.service[61837]: request: DELETE /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 HTTP/1.1 Apr 14 01:49:03 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:49:03 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:49:03 user devstack@n-api.service[61837]: Connection: close Apr 14 01:49:03 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:49:03 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:49:03 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:49:03 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:49:03 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLBO07-FVq8q34K3wmiWnuGjuaT_Y3dHtVK8V8CUtToaG2Am7gx6cHqFq9znqIsQ4f2Rplr2wVQmbq6e_fVJDNz_RUNX7a9bkiZJ6GSmd0J1jNxp-MnwLcepy9yq4LESKWWDx7KHv7WseuuFOHvwnfecpHoV0s9mL_RdFC-PmC2FUyE Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Project-Id: 7782019f67b04982a58ed5272dc4cbb5 Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-819739955 Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7782019f67b04982a58ed5272dc4cbb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7782019f67b04982a58ed5272dc4cbb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7782019f67b04982a58ed5272dc4cbb5"}]}] Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Tenant: tempest-TaggedBootDevicesTest_v242-819739955 Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Tenant-Id: 7782019f67b04982a58ed5272dc4cbb5 Apr 14 01:49:03 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-819739955 Apr 14 01:49:03 user devstack@n-api.service[61837]: X-User: tempest-TaggedBootDevicesTest_v242-819739955-project-member Apr 14 01:49:03 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:49:03 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:49:03 user devstack@n-api.service[61837]: X-User-Id: c4e5234d2ffe4dc898d22be4bd648c47 Apr 14 01:49:03 user devstack@n-api.service[61837]: X-User-Name: tempest-TaggedBootDevicesTest_v242-819739955-project-member Apr 14 01:49:03 user devstack@n-api.service[61837]: method: > Apr 14 01:49:03 user devstack@n-api.service[61837]: exception: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61837]: action_args: {'id': '4f8101aa-2078-4f0e-becb-62636c747c60'} Apr 14 01:49:03 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Returning 404 to user: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:49:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3c2ab814-9643-4936-bb5d-1d86f2f4b0d9 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60" status: 404 len: 111 microversion: 2.42 time: 0.035775 Apr 14 01:49:03 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 168/506] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:49:03 2023] DELETE /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:03 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] HTTP exception thrown: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Request method failure captured: Apr 14 01:49:03 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 HTTP/1.1 Apr 14 01:49:03 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:49:03 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:49:03 user devstack@n-api.service[61836]: Connection: close Apr 14 01:49:03 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:49:03 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:49:03 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:49:03 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:49:03 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLBO07-FVq8q34K3wmiWnuGjuaT_Y3dHtVK8V8CUtToaG2Am7gx6cHqFq9znqIsQ4f2Rplr2wVQmbq6e_fVJDNz_RUNX7a9bkiZJ6GSmd0J1jNxp-MnwLcepy9yq4LESKWWDx7KHv7WseuuFOHvwnfecpHoV0s9mL_RdFC-PmC2FUyE Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Project-Id: 7782019f67b04982a58ed5272dc4cbb5 Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-819739955 Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7782019f67b04982a58ed5272dc4cbb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7782019f67b04982a58ed5272dc4cbb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7782019f67b04982a58ed5272dc4cbb5"}]}] Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Tenant: tempest-TaggedBootDevicesTest_v242-819739955 Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Tenant-Id: 7782019f67b04982a58ed5272dc4cbb5 Apr 14 01:49:03 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-819739955 Apr 14 01:49:03 user devstack@n-api.service[61836]: X-User: tempest-TaggedBootDevicesTest_v242-819739955-project-member Apr 14 01:49:03 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:49:03 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:49:03 user devstack@n-api.service[61836]: X-User-Id: c4e5234d2ffe4dc898d22be4bd648c47 Apr 14 01:49:03 user devstack@n-api.service[61836]: X-User-Name: tempest-TaggedBootDevicesTest_v242-819739955-project-member Apr 14 01:49:03 user devstack@n-api.service[61836]: method: > Apr 14 01:49:03 user devstack@n-api.service[61836]: exception: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61836]: action_args: {'id': '4f8101aa-2078-4f0e-becb-62636c747c60'} Apr 14 01:49:03 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. Apr 14 01:49:03 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:49:03 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Returning 404 to user: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:49:03 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-461f0176-4415-47c9-85cb-73641dbe8093 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60" status: 404 len: 111 microversion: 2.42 time: 0.103422 Apr 14 01:49:03 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 170/507] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:49:03 2023] GET /compute/v2.1/servers/4f8101aa-2078-4f0e-becb-62636c747c60 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:49:06 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b6fc27ea-30f3-43e1-a93e-3d7d130b9bc6 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'create', calling method: .version_select at 0x7fd420fb2c20>, body: {"keypair": {"name": "tempest-keypair-1472759355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK5vWQCKiGuvwej8MZ61wsOrdvHzkY8KKRb64YirQyItNzZ+qUyi3rsN2xXflr+RBnZBMnmrlu6xsd3Isj7tFk7wOqGbcQSauLFOHMBPmHHo5KdwuxT7vQvU/ChwXXgmw=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:06 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-b6fc27ea-30f3-43e1-a93e-3d7d130b9bc6 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting quotas for project a6d05ca328d64f2aa1d19550475edba3. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:49:06 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-b6fc27ea-30f3-43e1-a93e-3d7d130b9bc6 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting quotas for user 2a5da3e233c74524a953ce0d4e074077 and project a6d05ca328d64f2aa1d19550475edba3. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:49:06 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b6fc27ea-30f3-43e1-a93e-3d7d130b9bc6 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.225755 Apr 14 01:49:06 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 170/508] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 01:49:06 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 227 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1301145911", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a7b6c0bc-d2de-4431-821b-c2917738e556"}], "security_groups": [{"name": "tempest-securitygroup--401643172"}], "key_name": "tempest-keypair-1472759355", "user_data": "}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] validate_networks() for [('a7b6c0bc-d2de-4431-821b-c2917738e556', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting quotas for project a6d05ca328d64f2aa1d19550475edba3. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting quotas for user 2a5da3e233c74524a953ce0d4e074077 and project a6d05ca328d64f2aa1d19550475edba3. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:49:08 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:49:09 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:49:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.686987 Apr 14 01:49:09 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 169/509] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 01:49:08 2023] POST /compute/v2.1/servers => generated 399 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 01:49:09 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ebd3437f-2698-411a-a6e2-5e08ba9b99a9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:09 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ebd3437f-2698-411a-a6e2-5e08ba9b99a9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:09 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-ebd3437f-2698-411a-a6e2-5e08ba9b99a9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:09 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-ebd3437f-2698-411a-a6e2-5e08ba9b99a9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:09 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-ebd3437f-2698-411a-a6e2-5e08ba9b99a9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:09 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ebd3437f-2698-411a-a6e2-5e08ba9b99a9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 200 len: 1276 microversion: 2.20 time: 0.093015 Apr 14 01:49:09 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 171/510] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:49:09 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:49:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] Creating event network-changed:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:49:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028943 Apr 14 01:49:12 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 171/511] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:12 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:12 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-a9019b80-0d9e-4c12-8a6e-6bd25f197502 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1656 microversion: 2.1 time: 0.167239 Apr 14 01:49:12 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 170/512] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:49:12 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1656 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:49:12 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1446339-0ce8-401e-b2e0-c4811b486a1a"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:12 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:13 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283069 Apr 14 01:49:13 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 172/513] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:49:12 2023] POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:14 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "name": "network-vif-plugged", "status": "completed", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] Creating event network-vif-plugged:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:49:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034681 Apr 14 01:49:14 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 172/514] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:16 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "name": "network-vif-plugged", "status": "completed", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:16 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:16 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] Creating event network-vif-plugged:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:49:16 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033293 Apr 14 01:49:16 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 171/515] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:16 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:16 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:16 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ddf7fb12-7023-4111-85a2-2eb15d51d29e tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28" status: 200 len: 1392 microversion: 2.1 time: 0.235804 Apr 14 01:49:16 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 173/516] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:49:16 2023] GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 => generated 1392 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1833990483"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:16 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-82990348", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "365cbeec-3756-4258-a135-04112bdda4b4"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:16 user devstack@n-api.service[61835]: INFO nova.compute.api [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Attempting to quiesce instance before volume snapshot. Apr 14 01:49:16 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] validate_networks() for [('365cbeec-3756-4258-a135-04112bdda4b4', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:16 user devstack@n-api.service[61835]: INFO nova.compute.api [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 01:49:16 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Creating snapshot from volume f9cb54ed-9520-43e9-a1c8-2be10b7f955e. {{(pid=61835) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting quotas for project 219c39c8299e46368012a947fdfbe5fd. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting quotas for user 7ed01a83531f4c6bb18a4593284baf05 and project 219c39c8299e46368012a947fdfbe5fd. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:49:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:49:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.754963 Apr 14 01:49:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 172/517] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 01:49:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 01:49:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-87a570b8-ec81-4159-82f2-243ad4def8ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:17 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-87a570b8-ec81-4159-82f2-243ad4def8ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:17 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-87a570b8-ec81-4159-82f2-243ad4def8ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:17 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-87a570b8-ec81-4159-82f2-243ad4def8ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:17 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-87a570b8-ec81-4159-82f2-243ad4def8ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-87a570b8-ec81-4159-82f2-243ad4def8ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2" status: 200 len: 1393 microversion: 2.87 time: 0.103215 Apr 14 01:49:17 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 174/518] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:49:17 2023] GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2 => generated 1393 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:49:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-17d36fb3-c2fc-43d6-a60c-35cad529ab75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28/action" status: 202 len: 0 microversion: 2.1 time: 3.087074 Apr 14 01:49:19 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 173/519] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:49:16 2023] POST /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28/action => generated 0 bytes in 3089 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-957339692", "imageRef": "bdcaffbf-53d5-4766-b9e2-130897a929c1", "flavorRef": "42", "networks": [{"uuid": "74c65fc2-ff90-46a4-a5e1-300009f92343"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] validate_networks() for [('74c65fc2-ff90-46a4-a5e1-300009f92343', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-8e18745c-c9b1-441d-8f28-38b905429bf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1702 microversion: 2.1 time: 0.166782 Apr 14 01:49:20 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 175/520] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:49:20 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1702 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-311342760", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for user 50e3354ac1a84c59a7dee8e1ae6e771a and project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:49:20 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='8c494dc1-9b6c-456f-9b65-71233f5e3f85',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:20 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.905601 Apr 14 01:49:20 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 173/521] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:49:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-7f742a12-948c-4e99-b131-ec7d8e4164b9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:20 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-7f742a12-948c-4e99-b131-ec7d8e4164b9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:20 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: dict_keys(['metadata_items']) {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for user 78ccd1a1ec1b486981d850881734fe02 and project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: dict_keys(['metadata_items']) {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-7f742a12-948c-4e99-b131-ec7d8e4164b9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-7f742a12-948c-4e99-b131-ec7d8e4164b9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573" status: 200 len: 1223 microversion: 2.1 time: 0.099558 Apr 14 01:49:21 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 176/522] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:49:20 2023] GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:21 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/action" status: 202 len: 1158 microversion: 2.1 time: 0.419148 Apr 14 01:49:21 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 174/523] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 01:49:20 2023] POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/action => generated 1158 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 01:49:21 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae82789e-1bed-419b-a580-68ff7ed03ef2", "tag": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] Creating event network-changed:1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance ae82789e-1bed-419b-a580-68ff7ed03ef2 on user Apr 14 01:49:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046123 Apr 14 01:49:21 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 174/524] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:21 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-a8cc4635-bd05-446c-89a5-31b2186c9f8d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1730 microversion: 2.1 time: 0.240599 Apr 14 01:49:21 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 177/525] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:49:21 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:49:23 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-unplugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}, {"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Creating event network-vif-unplugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:49:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:49:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033088 Apr 14 01:49:23 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 175/526] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:23 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae82789e-1bed-419b-a580-68ff7ed03ef2", "name": "network-vif-plugged", "status": "completed", "tag": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] Creating event network-vif-plugged:1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance ae82789e-1bed-419b-a580-68ff7ed03ef2 on user Apr 14 01:49:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038205 Apr 14 01:49:24 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 175/527] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9be81ce-9ccc-4557-9763-33984b2c6573", "tag": "9e97257c-885b-434b-97cd-fe0f3ee85a43"}, {"server_uuid": "ae82789e-1bed-419b-a580-68ff7ed03ef2", "name": "network-vif-plugged", "status": "completed", "tag": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:26 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=29 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:26 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Creating event network-changed:9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance e9be81ce-9ccc-4557-9763-33984b2c6573 on user Apr 14 01:49:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Creating event network-vif-plugged:1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance ae82789e-1bed-419b-a580-68ff7ed03ef2 on user Apr 14 01:49:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038541 Apr 14 01:49:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 178/528] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:26 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] HTTP exception thrown: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Request method failure captured: Apr 14 01:49:27 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 HTTP/1.1 Apr 14 01:49:27 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:49:27 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:49:27 user devstack@n-api.service[61835]: Connection: close Apr 14 01:49:27 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:49:27 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:49:27 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:49:27 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:49:27 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8XOBsViHuKnHybsXrnQtd_ZJfWj5td05sTbzyiyyn1p8E4CmU9bRusRq99zpd0ETs3wMxsQHcOPYlhDm9qUPTkcGZcTosn0Mo4H3s8_XVoaK3ZA0pMsmloQ8yPZWr5o14A4PeHmRr16oUPZFV3YcuMrZvWpfF9fHy9Ln_BnWQRPEc Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Project-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}] Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Tenant: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Tenant-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:49:27 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:49:27 user devstack@n-api.service[61835]: X-User: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:49:27 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:49:27 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:49:27 user devstack@n-api.service[61835]: X-User-Id: 236828e284154097a25f59eaedf47c29 Apr 14 01:49:27 user devstack@n-api.service[61835]: X-User-Name: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:49:27 user devstack@n-api.service[61835]: method: > Apr 14 01:49:27 user devstack@n-api.service[61835]: exception: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61835]: action_args: {'id': '2dfd39c9-8535-40d0-863d-c30fc98103e6'} Apr 14 01:49:27 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Returning 404 to user: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:49:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-e1980516-bd50-4789-8fd2-f1f3331e643d tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6" status: 404 len: 111 microversion: 2.1 time: 0.045233 Apr 14 01:49:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 176/529] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:49:27 2023] DELETE /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] HTTP exception thrown: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Request method failure captured: Apr 14 01:49:27 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 HTTP/1.1 Apr 14 01:49:27 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:49:27 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:49:27 user devstack@n-api.service[61837]: Connection: close Apr 14 01:49:27 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:49:27 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:49:27 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:49:27 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:49:27 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8XOBsViHuKnHybsXrnQtd_ZJfWj5td05sTbzyiyyn1p8E4CmU9bRusRq99zpd0ETs3wMxsQHcOPYlhDm9qUPTkcGZcTosn0Mo4H3s8_XVoaK3ZA0pMsmloQ8yPZWr5o14A4PeHmRr16oUPZFV3YcuMrZvWpfF9fHy9Ln_BnWQRPEc Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Project-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Project-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}] Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Tenant: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Tenant-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:49:27 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:49:27 user devstack@n-api.service[61837]: X-User: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:49:27 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:49:27 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:49:27 user devstack@n-api.service[61837]: X-User-Id: 236828e284154097a25f59eaedf47c29 Apr 14 01:49:27 user devstack@n-api.service[61837]: X-User-Name: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:49:27 user devstack@n-api.service[61837]: method: > Apr 14 01:49:27 user devstack@n-api.service[61837]: exception: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61837]: action_args: {'id': '2dfd39c9-8535-40d0-863d-c30fc98103e6'} Apr 14 01:49:27 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. Apr 14 01:49:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:49:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Returning 404 to user: Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:49:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-777f8c78-7a26-470c-bc4d-2bae2549a2dd tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6" status: 404 len: 111 microversion: 2.1 time: 0.032765 Apr 14 01:49:27 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 176/530] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:49:27 2023] GET /compute/v2.1/servers/2dfd39c9-8535-40d0-863d-c30fc98103e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:49:27 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:27 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:27 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:49:27 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a" status: 204 len: 0 microversion: 2.1 time: 0.199758 Apr 14 01:49:27 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 179/531] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:49:27 2023] DELETE /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:27 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-1d03abd3-7b7a-41c0-99c2-b84a56e113de tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a" status: 200 len: 1500 microversion: 2.1 time: 0.231731 Apr 14 01:49:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 177/532] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:49:27 2023] GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a => generated 1500 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:49:28 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da60f4f1-2474-453f-8f84-c95daf02431a", "name": "network-vif-unplugged", "status": "completed", "tag": "b8356c3e-ccfb-44ae-8020-af80bcb28a43"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] Creating event network-vif-unplugged:b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance da60f4f1-2474-453f-8f84-c95daf02431a on user Apr 14 01:49:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050565 Apr 14 01:49:28 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 177/533] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:30 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da60f4f1-2474-453f-8f84-c95daf02431a", "name": "network-vif-plugged", "status": "completed", "tag": "b8356c3e-ccfb-44ae-8020-af80bcb28a43"}, {"server_uuid": "da60f4f1-2474-453f-8f84-c95daf02431a", "name": "network-vif-deleted", "tag": "b8356c3e-ccfb-44ae-8020-af80bcb28a43"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:30 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] Creating event network-vif-plugged:b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance da60f4f1-2474-453f-8f84-c95daf02431a on user Apr 14 01:49:30 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] Creating event network-vif-deleted:b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance da60f4f1-2474-453f-8f84-c95daf02431a on user Apr 14 01:49:30 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050700 Apr 14 01:49:30 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 180/534] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:34 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:34 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:49:34 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041954 Apr 14 01:49:34 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 178/535] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:36 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:36 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:36 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=18 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:36 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=25 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:49:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052920 Apr 14 01:49:36 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 178/536] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:39 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:39 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9be81ce-9ccc-4557-9763-33984b2c6573", "name": "network-vif-plugged", "status": "completed", "tag": "9e97257c-885b-434b-97cd-fe0f3ee85a43"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:39 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] Creating event network-vif-plugged:9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance e9be81ce-9ccc-4557-9763-33984b2c6573 on user Apr 14 01:49:39 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067882 Apr 14 01:49:39 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 181/537] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9be81ce-9ccc-4557-9763-33984b2c6573", "name": "network-vif-plugged", "status": "completed", "tag": "9e97257c-885b-434b-97cd-fe0f3ee85a43"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] Creating event network-vif-plugged:9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance e9be81ce-9ccc-4557-9763-33984b2c6573 on user Apr 14 01:49:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045817 Apr 14 01:49:41 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 179/538] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f963f563-7eff-40eb-9d1c-66a242662e1d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f963f563-7eff-40eb-9d1c-66a242662e1d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f963f563-7eff-40eb-9d1c-66a242662e1d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f963f563-7eff-40eb-9d1c-66a242662e1d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f963f563-7eff-40eb-9d1c-66a242662e1d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f963f563-7eff-40eb-9d1c-66a242662e1d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f963f563-7eff-40eb-9d1c-66a242662e1d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f963f563-7eff-40eb-9d1c-66a242662e1d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:52 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'flavor' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:49:52 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f963f563-7eff-40eb-9d1c-66a242662e1d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055326 Apr 14 01:49:52 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 182/539] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:49:52 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:49:52 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc/action" status: 200 len: 32 microversion: 2.1 time: 0.124549 Apr 14 01:49:52 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 179/540] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:49:52 2023] POST /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc/action => generated 32 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=23 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:52 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:52 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b2360ac7-0e3c-4aed-96a6-2a4ae888d11a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc" status: 200 len: 1509 microversion: 2.1 time: 0.377133 Apr 14 01:49:52 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 180/541] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:49:52 2023] GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc => generated 1509 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:49:53 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-unplugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:53 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] Creating event network-vif-unplugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:49:53 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036716 Apr 14 01:49:53 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 183/542] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:55 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-plugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:55 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] Creating event network-vif-plugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:49:55 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030359 Apr 14 01:49:55 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 180/543] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4044000e-5f2c-4303-b69d-07287f59fbcb"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:56 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "POST /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364971 Apr 14 01:49:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 181/544] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:49:56 2023] POST /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:49:57 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-plugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}, {"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-plugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:49:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Creating event network-vif-plugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:49:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Creating event network-vif-plugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:49:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032489 Apr 14 01:49:57 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 184/545] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:49:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:59 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:49:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e904fde8-4d4c-489f-82ef-6d76d40084d3 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 200 len: 1587 microversion: 2.20 time: 0.183143 Apr 14 01:49:59 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 181/546] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:49:59 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 1587 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:50:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:04 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:04 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'services' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:50:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments/4044000e-5f2c-4303-b69d-07287f59fbcb" status: 202 len: 0 microversion: 2.1 time: 0.210128 Apr 14 01:50:04 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 182/547] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:50:04 2023] DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments/4044000e-5f2c-4303-b69d-07287f59fbcb => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:50:04 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-8459649e-272a-4d5a-bc33-8ea387a4dd40 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:04 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-8459649e-272a-4d5a-bc33-8ea387a4dd40 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:04 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8459649e-272a-4d5a-bc33-8ea387a4dd40 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:04 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8459649e-272a-4d5a-bc33-8ea387a4dd40 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:04 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8459649e-272a-4d5a-bc33-8ea387a4dd40 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:04 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8459649e-272a-4d5a-bc33-8ea387a4dd40 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:04 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8459649e-272a-4d5a-bc33-8ea387a4dd40 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:04 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-8459649e-272a-4d5a-bc33-8ea387a4dd40 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:04 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-8459649e-272a-4d5a-bc33-8ea387a4dd40 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Apr 14 01:50:04 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 185/548] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:50:04 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:50:07 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:50:07 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f2a45738-afbe-44e8-b310-a2e08f8dace2 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2" status: 200 len: 1690 microversion: 2.87 time: 0.236359 Apr 14 01:50:07 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 182/549] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:50:07 2023] GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2 => generated 1690 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:50:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:11 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:11 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:50:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-8cf70243-c8d5-44e7-8d48-fe1cad4d5729 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573" status: 200 len: 1549 microversion: 2.1 time: 0.160509 Apr 14 01:50:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 183/550] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:50:11 2023] GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:50:11 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:11 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:11 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:50:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-138fb18c-e265-4968-9b27-d0d0ffc0aef8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1721 microversion: 2.1 time: 0.180291 Apr 14 01:50:11 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 186/551] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:50:11 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=10 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:18 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] HTTP exception thrown: Instance da60f4f1-2474-453f-8f84-c95daf02431a could not be found. Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Request method failure captured: Apr 14 01:50:18 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a HTTP/1.1 Apr 14 01:50:18 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:50:18 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:50:18 user devstack@n-api.service[61837]: Connection: close Apr 14 01:50:18 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:50:18 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:50:18 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:50:18 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:50:18 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8XOBsViHuKnHybsXrnQtd_ZJfWj5td05sTbzyiyyn1p8E4CmU9bRusRq99zpd0ETs3wMxsQHcOPYlhDm9qUPTkcGZcTosn0Mo4H3s8_XVoaK3ZA0pMsmloQ8yPZWr5o14A4PeHmRr16oUPZFV3YcuMrZvWpfF9fHy9Ln_BnWQRPEc Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Project-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Project-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/907f632263e04bf2a6c8ff1bae77a5c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/907f632263e04bf2a6c8ff1bae77a5c7"}]}] Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Tenant: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Tenant-Id: 907f632263e04bf2a6c8ff1bae77a5c7 Apr 14 01:50:18 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1259366012 Apr 14 01:50:18 user devstack@n-api.service[61837]: X-User: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:50:18 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:50:18 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:50:18 user devstack@n-api.service[61837]: X-User-Id: 236828e284154097a25f59eaedf47c29 Apr 14 01:50:18 user devstack@n-api.service[61837]: X-User-Name: tempest-ServersNegativeTestJSON-1259366012-project-member Apr 14 01:50:18 user devstack@n-api.service[61837]: method: > Apr 14 01:50:18 user devstack@n-api.service[61837]: exception: Instance da60f4f1-2474-453f-8f84-c95daf02431a could not be found. Apr 14 01:50:18 user devstack@n-api.service[61837]: action_args: {'id': 'da60f4f1-2474-453f-8f84-c95daf02431a'} Apr 14 01:50:18 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da60f4f1-2474-453f-8f84-c95daf02431a could not be found. Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da60f4f1-2474-453f-8f84-c95daf02431a could not be found. Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da60f4f1-2474-453f-8f84-c95daf02431a could not be found. Apr 14 01:50:18 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:50:18 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Returning 404 to user: Instance da60f4f1-2474-453f-8f84-c95daf02431a could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:50:18 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-17d1dff9-4169-4a02-9f95-d114bf8ce1fc tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a" status: 404 len: 111 microversion: 2.1 time: 0.037397 Apr 14 01:50:18 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 183/552] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:50:18 2023] GET /compute/v2.1/servers/da60f4f1-2474-453f-8f84-c95daf02431a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:50:29 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:29 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-bef502ef-66bb-4470-9bb9-dded75bea904 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'create', calling method: .version_select at 0x7fd420fb3370>, body: {"keypair": {"name": "tempest-keypair-2007571811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:50:29 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-bef502ef-66bb-4470-9bb9-dded75bea904 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting quotas for project 0f650e04d2c947498b9e7a8d002862ad. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:50:29 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-bef502ef-66bb-4470-9bb9-dded75bea904 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting quotas for user ba0894753a074f99ab226fde0565dd28 and project 0f650e04d2c947498b9e7a8d002862ad. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:50:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-bef502ef-66bb-4470-9bb9-dded75bea904 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217410 Apr 14 01:50:29 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 184/553] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:50:29 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:50:31 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-325708357", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a"}], "security_groups": [{"name": "tempest-securitygroup--196475237"}], "key_name": "tempest-keypair-2007571811", "user_data": "}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:50:31 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=10 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:31 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=22 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:31 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] validate_networks() for [('fe9d57b9-96e8-424e-8dc9-0c95f1aff03a', None, None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting quotas for project 0f650e04d2c947498b9e7a8d002862ad. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting quotas for user ba0894753a074f99ab226fde0565dd28 and project 0f650e04d2c947498b9e7a8d002862ad. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:50:32 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:50:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.782603 Apr 14 01:50:32 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 187/554] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:50:31 2023] POST /compute/v2.1/servers => generated 399 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:50:32 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-4aea0d36-1e42-4d3c-8b5a-2c517a99bf86 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:32 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-4aea0d36-1e42-4d3c-8b5a-2c517a99bf86 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:32 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:32 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:32 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-4aea0d36-1e42-4d3c-8b5a-2c517a99bf86 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:50:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-4aea0d36-1e42-4d3c-8b5a-2c517a99bf86 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1231 microversion: 2.1 time: 0.196176 Apr 14 01:50:32 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 184/555] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:50:32 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1231 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:50:35 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:50:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] Creating event network-changed:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:50:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032509 Apr 14 01:50:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 185/556] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:50:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:50:37 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-plugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:50:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:37 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] Creating event network-vif-plugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:50:37 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031547 Apr 14 01:50:37 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 188/557] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:50:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:50:39 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-plugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:50:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:39 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] Creating event network-vif-plugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:50:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033963 Apr 14 01:50:40 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 185/558] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:50:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:50:42 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:42 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:42 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:42 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:43 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:50:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-70ceb9c7-3527-441c-b65a-6c8b344a66d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc" status: 200 len: 1489 microversion: 2.1 time: 0.903614 Apr 14 01:50:43 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 186/559] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:50:42 2023] GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc => generated 1489 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-339e88ee-165e-4362-88a0-2d9031fe2370 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-339e88ee-165e-4362-88a0-2d9031fe2370 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-339e88ee-165e-4362-88a0-2d9031fe2370 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-339e88ee-165e-4362-88a0-2d9031fe2370 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-339e88ee-165e-4362-88a0-2d9031fe2370 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:54 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-339e88ee-165e-4362-88a0-2d9031fe2370 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-339e88ee-165e-4362-88a0-2d9031fe2370 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-339e88ee-165e-4362-88a0-2d9031fe2370 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-339e88ee-165e-4362-88a0-2d9031fe2370 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.205520 Apr 14 01:50:55 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 189/560] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:50:54 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 25 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "016cf8b7-6ab7-4810-bc0a-a27d51484e71"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "POST /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298648 Apr 14 01:50:59 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 186/561] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:50:58 2023] POST /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ff6a3026-6ec5-4d6c-88bd-945ec87efbb0 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ff6a3026-6ec5-4d6c-88bd-945ec87efbb0 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ff6a3026-6ec5-4d6c-88bd-945ec87efbb0 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ff6a3026-6ec5-4d6c-88bd-945ec87efbb0 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ff6a3026-6ec5-4d6c-88bd-945ec87efbb0 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ff6a3026-6ec5-4d6c-88bd-945ec87efbb0 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ff6a3026-6ec5-4d6c-88bd-945ec87efbb0 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:50:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ff6a3026-6ec5-4d6c-88bd-945ec87efbb0 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:50:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ff6a3026-6ec5-4d6c-88bd-945ec87efbb0 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.112927 Apr 14 01:50:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 187/562] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 01:50:59 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-interface => generated 283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:51:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] Creating event network-changed:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:51:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034030 Apr 14 01:51:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 190/563] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:51:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2c97bae8-7e0d-4055-931d-313791a01398 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:00 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-2c97bae8-7e0d-4055-931d-313791a01398 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c97bae8-7e0d-4055-931d-313791a01398 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c97bae8-7e0d-4055-931d-313791a01398 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c97bae8-7e0d-4055-931d-313791a01398 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c97bae8-7e0d-4055-931d-313791a01398 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c97bae8-7e0d-4055-931d-313791a01398 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2c97bae8-7e0d-4055-931d-313791a01398 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:00 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-2c97bae8-7e0d-4055-931d-313791a01398 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/ips" status: 200 len: 110 microversion: 2.20 time: 0.038519 Apr 14 01:51:00 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 187/564] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 01:51:00 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/ips => generated 110 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:51:01 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:01 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:01 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'flavor' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:51:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/action" status: 202 len: 0 microversion: 2.20 time: 0.842681 Apr 14 01:51:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 188/565] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 01:51:01 2023] POST /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:51:02 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:02 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:02 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:03 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:03 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:03 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-06d21d7d-39c1-42a4-a371-1621425a7cc4 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 200 len: 1712 microversion: 2.20 time: 0.221375 Apr 14 01:51:03 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 191/566] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:51:02 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 1712 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:51:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "name": "network-vif-unplugged", "status": "completed", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] Creating event network-vif-unplugged:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:51:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096300 Apr 14 01:51:03 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 188/567] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:51:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:51:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "name": "network-vif-plugged", "status": "completed", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] Creating event network-vif-plugged:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:51:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029721 Apr 14 01:51:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 189/568] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:51:07 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:07 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:07 user devstack@n-api.service[61836]: DEBUG nova.objects.instance [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'services' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=61836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:51:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments/016cf8b7-6ab7-4810-bc0a-a27d51484e71" status: 202 len: 0 microversion: 2.1 time: 0.240588 Apr 14 01:51:07 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 192/569] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:51:07 2023] DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments/016cf8b7-6ab7-4810-bc0a-a27d51484e71 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:51:07 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e1021f7f-f3c1-401b-947b-cb1b17a7e823 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:07 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e1021f7f-f3c1-401b-947b-cb1b17a7e823 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e1021f7f-f3c1-401b-947b-cb1b17a7e823 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e1021f7f-f3c1-401b-947b-cb1b17a7e823 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e1021f7f-f3c1-401b-947b-cb1b17a7e823 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e1021f7f-f3c1-401b-947b-cb1b17a7e823 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e1021f7f-f3c1-401b-947b-cb1b17a7e823 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e1021f7f-f3c1-401b-947b-cb1b17a7e823 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:07 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e1021f7f-f3c1-401b-947b-cb1b17a7e823 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056942 Apr 14 01:51:07 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 189/570] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:51:07 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:51:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] Creating event network-changed:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:51:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111474 Apr 14 01:51:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 190/571] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:51:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:51:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-556012589"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:08 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2/action" status: 202 len: 52 microversion: 2.87 time: 0.838651 Apr 14 01:51:08 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 193/572] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 01:51:08 2023] POST /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2/action => generated 52 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:11 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d7630c0a-2b61-4904-9894-d4b5713b0e75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573" status: 200 len: 1549 microversion: 2.1 time: 0.153497 Apr 14 01:51:11 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 190/573] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:51:11 2023] GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:51:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:11 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:11 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:51:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573" status: 204 len: 0 microversion: 2.1 time: 0.137142 Apr 14 01:51:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 191/574] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:51:11 2023] DELETE /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:51:11 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:11 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:11 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c6fd98cc-9fee-493d-82b0-7160881885bc tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573" status: 200 len: 1555 microversion: 2.1 time: 0.175853 Apr 14 01:51:11 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 194/575] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:51:11 2023] GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:12 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9be81ce-9ccc-4557-9763-33984b2c6573", "name": "network-vif-unplugged", "status": "completed", "tag": "9e97257c-885b-434b-97cd-fe0f3ee85a43"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] Creating event network-vif-unplugged:9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance e9be81ce-9ccc-4557-9763-33984b2c6573 on user Apr 14 01:51:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051168 Apr 14 01:51:12 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 192/576] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:51:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:51:12 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-07ae4595-86fe-43e5-8db0-03fe5454a9f1 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1721 microversion: 2.1 time: 0.362146 Apr 14 01:51:12 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 191/577] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:51:11 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:51:12 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:12 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:12 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:12 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-3b8f0937-ede9-41b4-86e5-773fb0543f94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1721 microversion: 2.1 time: 0.144269 Apr 14 01:51:12 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 195/578] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:51:12 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:51:14 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9be81ce-9ccc-4557-9763-33984b2c6573", "name": "network-vif-plugged", "status": "completed", "tag": "9e97257c-885b-434b-97cd-fe0f3ee85a43"}, {"server_uuid": "e9be81ce-9ccc-4557-9763-33984b2c6573", "name": "network-vif-deleted", "tag": "9e97257c-885b-434b-97cd-fe0f3ee85a43"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] Creating event network-vif-plugged:9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance e9be81ce-9ccc-4557-9763-33984b2c6573 on user Apr 14 01:51:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] Creating event network-vif-deleted:9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance e9be81ce-9ccc-4557-9763-33984b2c6573 on user Apr 14 01:51:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031373 Apr 14 01:51:14 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 193/579] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:51:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:14 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-18ca81c0-9b89-4f1b-93ae-365231c90922 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2" status: 200 len: 1690 microversion: 2.87 time: 0.155664 Apr 14 01:51:14 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 192/580] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:51:14 2023] GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=14 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:22 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-1578ae0d-b439-4aea-8723-cfb6f6dd4aa1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1537 microversion: 2.1 time: 0.158545 Apr 14 01:51:22 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 196/581] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:51:22 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] HTTP exception thrown: Cannot 'attach_volume' instance a19a1c08-5454-481b-bb5a-70c39ead9afc while it is in vm_state rescued Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Request method failure captured: Apr 14 01:51:43 user devstack@n-api.service[61835]: request: POST /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc/os-volume_attachments HTTP/1.1 Apr 14 01:51:43 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:51:43 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:51:43 user devstack@n-api.service[61835]: Connection: close Apr 14 01:51:43 user devstack@n-api.service[61835]: Content-Length: 74 Apr 14 01:51:43 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:51:43 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:51:43 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:51:43 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLAimNIpGvJxJ2K7x8_hYJlXVV3qbjMTDXN3Xm447JCUfxZDn-Wf0sl4YUvlfGEuUHZqEnw9ZwrHlGRKKi38xTuTU3GwUFRksR_fDEaBtrl_61Nk7ZcffAI89Uw3GQZ3tj6UHny8Z7R-nkYcye6xq1TYYcwo_Vs_FB25z0QmbgeF8b0 Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Project-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}] Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Tenant-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 01:51:43 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 01:51:43 user devstack@n-api.service[61835]: X-User: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 01:51:43 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:51:43 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:51:43 user devstack@n-api.service[61835]: X-User-Id: eeb5f26be86e43b3b61fff98fdc83cf3 Apr 14 01:51:43 user devstack@n-api.service[61835]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 01:51:43 user devstack@n-api.service[61835]: Apr 14 01:51:43 user devstack@n-api.service[61835]: {"volumeAttachment": {"volumeId": "8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b"}} Apr 14 01:51:43 user devstack@n-api.service[61835]: method: > Apr 14 01:51:43 user devstack@n-api.service[61835]: exception: Cannot 'attach_volume' instance a19a1c08-5454-481b-bb5a-70c39ead9afc while it is in vm_state rescued Apr 14 01:51:43 user devstack@n-api.service[61835]: action_args: {'server_id': 'a19a1c08-5454-481b-bb5a-70c39ead9afc', 'body': {'volumeAttachment': {'volumeId': '8c5de8a6-f3fc-4a8e-8777-7ef1534acd4b'}}} Apr 14 01:51:43 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a19a1c08-5454-481b-bb5a-70c39ead9afc in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a19a1c08-5454-481b-bb5a-70c39ead9afc while it is in vm_state rescued Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a19a1c08-5454-481b-bb5a-70c39ead9afc while it is in vm_state rescued Apr 14 01:51:43 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:51:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Returning 409 to user: Cannot 'attach_volume' instance a19a1c08-5454-481b-bb5a-70c39ead9afc while it is in vm_state rescued {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:51:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-def9372b-b082-4f2b-a206-c3144700f4f0 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051423 Apr 14 01:51:43 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 194/582] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:51:43 2023] POST /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=16 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:43 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:43 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc/action" status: 202 len: 0 microversion: 2.1 time: 0.084783 Apr 14 01:51:43 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 193/583] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:51:43 2023] POST /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:43 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e2fc892c-6468-4358-85ae-eae65286515d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc" status: 200 len: 1497 microversion: 2.1 time: 0.149788 Apr 14 01:51:43 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 197/584] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:51:43 2023] GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:51:44 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-unplugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] Creating event network-vif-unplugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:51:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032902 Apr 14 01:51:44 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 195/585] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:51:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:51:46 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-plugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}, {"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-plugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}, {"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-plugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:51:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Creating event network-vif-plugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:51:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Creating event network-vif-plugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:51:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Creating event network-vif-plugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 01:51:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039043 Apr 14 01:51:46 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 194/586] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:51:46 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:53 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:51:53 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-3a5215b7-3290-4aed-a0d2-92f4ce64e9b9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 200 len: 1653 microversion: 2.20 time: 0.156107 Apr 14 01:51:53 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 198/587] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:51:53 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 1653 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a7a69ed9-deb8-430f-8eef-be36d226a5fa tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a7a69ed9-deb8-430f-8eef-be36d226a5fa tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7a69ed9-deb8-430f-8eef-be36d226a5fa tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7a69ed9-deb8-430f-8eef-be36d226a5fa tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7a69ed9-deb8-430f-8eef-be36d226a5fa tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7a69ed9-deb8-430f-8eef-be36d226a5fa tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7a69ed9-deb8-430f-8eef-be36d226a5fa tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:51:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7a69ed9-deb8-430f-8eef-be36d226a5fa tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:51:57 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a7a69ed9-deb8-430f-8eef-be36d226a5fa tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047566 Apr 14 01:51:57 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 196/588] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:51:57 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:52:02 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 HTTP/1.1 Apr 14 01:52:02 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:52:02 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:52:02 user devstack@n-api.service[61837]: Connection: close Apr 14 01:52:02 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:52:02 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:52:02 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:52:02 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:52:02 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:02 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:02 user devstack@n-api.service[61837]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:02 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:52:02 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:52:02 user devstack@n-api.service[61837]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:52:02 user devstack@n-api.service[61837]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:02 user devstack@n-api.service[61837]: method: > Apr 14 01:52:02 user devstack@n-api.service[61837]: exception: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:02 user devstack@n-api.service[61837]: action_args: {'id': 'e9be81ce-9ccc-4557-9763-33984b2c6573'} Apr 14 01:52:02 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:02 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:52:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-1f1bb8eb-8070-41d3-a201-39f18b249e8d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573" status: 404 len: 111 microversion: 2.1 time: 0.043848 Apr 14 01:52:02 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 195/589] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:52:02 2023] GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=12 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:05 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:52:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28" status: 204 len: 0 microversion: 2.1 time: 0.142919 Apr 14 01:52:05 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 199/590] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:52:05 2023] DELETE /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:52:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:05 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:05 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-735f2ccf-f12f-4e8a-a267-6354fe54a43b tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28" status: 200 len: 1398 microversion: 2.1 time: 0.208672 Apr 14 01:52:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 197/591] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:52:05 2023] GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 => generated 1398 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:52:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ccf53b5-9199-4812-a635-4f4f22fb5d28", "name": "network-vif-unplugged", "status": "completed", "tag": "d58d1594-1a97-4a63-be67-e8101e889654"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] Creating event network-vif-unplugged:d58d1594-1a97-4a63-be67-e8101e889654 for instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 on user Apr 14 01:52:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108239 Apr 14 01:52:05 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 196/592] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:07 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ccf53b5-9199-4812-a635-4f4f22fb5d28", "name": "network-vif-deleted", "tag": "d58d1594-1a97-4a63-be67-e8101e889654"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] Creating event network-vif-deleted:d58d1594-1a97-4a63-be67-e8101e889654 for instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 on user Apr 14 01:52:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030447 Apr 14 01:52:07 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 200/593] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ccf53b5-9199-4812-a635-4f4f22fb5d28", "name": "network-vif-plugged", "status": "completed", "tag": "d58d1594-1a97-4a63-be67-e8101e889654"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] Creating event network-vif-plugged:d58d1594-1a97-4a63-be67-e8101e889654 for instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 on user Apr 14 01:52:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035563 Apr 14 01:52:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 198/594] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:12 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:12 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'services' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:52:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments/b1446339-0ce8-401e-b2e0-c4811b486a1a" status: 202 len: 0 microversion: 2.1 time: 0.159683 Apr 14 01:52:12 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 197/595] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:52:12 2023] DELETE /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments/b1446339-0ce8-401e-b2e0-c4811b486a1a => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:52:12 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5a1a17e1-2a30-4229-bd8a-b1050c4785b7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:12 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5a1a17e1-2a30-4229-bd8a-b1050c4785b7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a1a17e1-2a30-4229-bd8a-b1050c4785b7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a1a17e1-2a30-4229-bd8a-b1050c4785b7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a1a17e1-2a30-4229-bd8a-b1050c4785b7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a1a17e1-2a30-4229-bd8a-b1050c4785b7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a1a17e1-2a30-4229-bd8a-b1050c4785b7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a1a17e1-2a30-4229-bd8a-b1050c4785b7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:12 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-5a1a17e1-2a30-4229-bd8a-b1050c4785b7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041067 Apr 14 01:52:12 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 201/596] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:52:12 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-831752770", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "destination_type": "volume"}], "networks": [{"uuid": "365cbeec-3756-4258-a135-04112bdda4b4"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] validate_networks() for [('365cbeec-3756-4258-a135-04112bdda4b4', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting quotas for project 219c39c8299e46368012a947fdfbe5fd. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting quotas for user 7ed01a83531f4c6bb18a4593284baf05 and project 219c39c8299e46368012a947fdfbe5fd. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:52:14 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:52:15 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.617951 Apr 14 01:52:15 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 199/597] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 01:52:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 01:52:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-54aa7bf2-d3f2-4aa6-a209-37b71c60ac89 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:15 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-54aa7bf2-d3f2-4aa6-a209-37b71c60ac89 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-54aa7bf2-d3f2-4aa6-a209-37b71c60ac89 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-54aa7bf2-d3f2-4aa6-a209-37b71c60ac89 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-54aa7bf2-d3f2-4aa6-a209-37b71c60ac89 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-54aa7bf2-d3f2-4aa6-a209-37b71c60ac89 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" status: 200 len: 1394 microversion: 2.87 time: 0.083472 Apr 14 01:52:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 198/598] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:52:15 2023] GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => generated 1394 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:52:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] Creating event network-changed:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:52:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041881 Apr 14 01:52:17 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 202/599] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:19 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] Creating event network-changed:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:52:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034691 Apr 14 01:52:19 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 200/600] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:52:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800" status: 204 len: 0 microversion: 2.1 time: 0.133006 Apr 14 01:52:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 199/601] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:52:22 2023] DELETE /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:52:22 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:22 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:22 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e25e45353e40b9a8bb14736c03fdeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740488dbb5114fb2b38be20f8ce4adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-828c0838-e3e4-4f50-a212-06312ad2967d tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800" status: 200 len: 1571 microversion: 2.1 time: 0.218456 Apr 14 01:52:22 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 203/602] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:52:22 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800 => generated 1571 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:52:22 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "name": "network-vif-unplugged", "status": "completed", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:22 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] Creating event network-vif-unplugged:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:52:22 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032964 Apr 14 01:52:22 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 201/603] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-93948ace-570c-43d3-9b06-09907eb20ece tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-93948ace-570c-43d3-9b06-09907eb20ece tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-93948ace-570c-43d3-9b06-09907eb20ece tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-93948ace-570c-43d3-9b06-09907eb20ece tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-93948ace-570c-43d3-9b06-09907eb20ece tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-93948ace-570c-43d3-9b06-09907eb20ece tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-93948ace-570c-43d3-9b06-09907eb20ece tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-93948ace-570c-43d3-9b06-09907eb20ece tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-93948ace-570c-43d3-9b06-09907eb20ece tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.100295 Apr 14 01:52:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 200/604] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:52:22 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/os-interface => generated 283 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "name": "network-vif-deleted", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] Creating event network-vif-deleted:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:52:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029439 Apr 14 01:52:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 204/605] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:24 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-e29c8a2c-4eb0-426c-8b65-227d7cebcf6d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:24 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-e29c8a2c-4eb0-426c-8b65-227d7cebcf6d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e29c8a2c-4eb0-426c-8b65-227d7cebcf6d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e29c8a2c-4eb0-426c-8b65-227d7cebcf6d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e29c8a2c-4eb0-426c-8b65-227d7cebcf6d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e29c8a2c-4eb0-426c-8b65-227d7cebcf6d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e29c8a2c-4eb0-426c-8b65-227d7cebcf6d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e29c8a2c-4eb0-426c-8b65-227d7cebcf6d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:24 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-e29c8a2c-4eb0-426c-8b65-227d7cebcf6d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/ips" status: 200 len: 105 microversion: 2.1 time: 0.041833 Apr 14 01:52:24 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 202/606] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 01:52:24 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/ips => generated 105 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "name": "network-vif-plugged", "status": "completed", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}, {"server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "name": "network-vif-plugged", "status": "completed", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}, {"server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "name": "network-vif-plugged", "status": "completed", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}, {"server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "name": "network-vif-unplugged", "status": "completed", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}, {"server_uuid": "74311da6-d6b8-4aea-b6ce-97db8da53800", "name": "network-vif-plugged", "status": "completed", "tag": "20a227b0-3b4d-4df0-b583-071771a0ae44"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Creating event network-vif-plugged:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:52:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Creating event network-vif-plugged:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:52:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Creating event network-vif-plugged:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:52:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Creating event network-vif-unplugged:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:52:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Creating event network-vif-plugged:20a227b0-3b4d-4df0-b583-071771a0ae44 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 on user Apr 14 01:52:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033363 Apr 14 01:52:24 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 201/607] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:24 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] Creating event network-changed:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:52:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031630 Apr 14 01:52:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 205/608] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d2a082d-59f8-4081-9ace-fc3ae1219b10"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338327 Apr 14 01:52:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 203/609] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:52:26 2023] POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:29 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:29 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-plugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] Creating event network-vif-plugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:52:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032607 Apr 14 01:52:29 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 202/610] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:31 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-plugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:31 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] Creating event network-vif-plugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:52:31 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029819 Apr 14 01:52:31 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 206/611] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:34 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:34 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a87cbe10-bf9f-4832-ac9f-ce9837d6a78e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc" status: 200 len: 1503 microversion: 2.1 time: 0.215968 Apr 14 01:52:34 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 204/612] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:52:34 2023] GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:52:34 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:34 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Going to try to stop instance {{(pid=61837) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 01:52:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/action" status: 202 len: 0 microversion: 2.1 time: 0.121463 Apr 14 01:52:34 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 203/613] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:52:34 2023] POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:52:34 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:34 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:35 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c0f6fcc8-9201-4144-b383-4c6bd3e901a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1712 microversion: 2.1 time: 0.159688 Apr 14 01:52:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 207/614] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:52:34 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:52:35 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-unplugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] Creating event network-vif-unplugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:52:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043250 Apr 14 01:52:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 205/615] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:37 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-plugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] Creating event network-vif-plugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:52:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031356 Apr 14 01:52:37 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 204/616] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:52:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-6abeae90-31f1-405b-8da8-c637a17716eb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26c6e12f-4381-4acd-a6e5-a979a6886f25"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-6abeae90-31f1-405b-8da8-c637a17716eb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6abeae90-31f1-405b-8da8-c637a17716eb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6abeae90-31f1-405b-8da8-c637a17716eb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6abeae90-31f1-405b-8da8-c637a17716eb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6abeae90-31f1-405b-8da8-c637a17716eb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6abeae90-31f1-405b-8da8-c637a17716eb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:53 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6abeae90-31f1-405b-8da8-c637a17716eb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:53 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-6abeae90-31f1-405b-8da8-c637a17716eb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286593 Apr 14 01:52:53 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 208/617] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 01:52:53 2023] POST /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=7 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:53 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61835) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 01:52:53 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/action" status: 202 len: 0 microversion: 2.20 time: 0.130747 Apr 14 01:52:53 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 206/618] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 01:52:53 2023] POST /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:53 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:54 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:54 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:52:54 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-dc1f0b3d-de91-4dec-8a9f-b71f5b722e3d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 200 len: 1739 microversion: 2.20 time: 0.172158 Apr 14 01:52:54 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 205/619] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:52:53 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:52:55 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 HTTP/1.1 Apr 14 01:52:55 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:52:55 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:52:55 user devstack@n-api.service[61836]: Connection: close Apr 14 01:52:55 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:52:55 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:52:55 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:52:55 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:52:55 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:55 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:55 user devstack@n-api.service[61836]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:55 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:52:55 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:52:55 user devstack@n-api.service[61836]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:52:55 user devstack@n-api.service[61836]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:55 user devstack@n-api.service[61836]: method: > Apr 14 01:52:55 user devstack@n-api.service[61836]: exception: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61836]: action_args: {'id': '1ccf53b5-9199-4812-a635-4f4f22fb5d28'} Apr 14 01:52:55 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:52:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-261d6c74-e1ef-4851-9e33-5d053e67e466 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28" status: 404 len: 111 microversion: 2.1 time: 0.029489 Apr 14 01:52:55 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 209/620] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:52:55 2023] GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:55 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:52:55 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 HTTP/1.1 Apr 14 01:52:55 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:52:55 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:52:55 user devstack@n-api.service[61835]: Connection: close Apr 14 01:52:55 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:52:55 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:52:55 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:52:55 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:52:55 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:55 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:55 user devstack@n-api.service[61835]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:55 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:52:55 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:52:55 user devstack@n-api.service[61835]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:52:55 user devstack@n-api.service[61835]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:55 user devstack@n-api.service[61835]: method: > Apr 14 01:52:55 user devstack@n-api.service[61835]: exception: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61835]: action_args: {'id': 'e9be81ce-9ccc-4557-9763-33984b2c6573'} Apr 14 01:52:55 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:52:55 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-3d364a1d-41c9-4738-9314-b9d55fc63ed1 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573" status: 404 len: 111 microversion: 2.1 time: 0.029420 Apr 14 01:52:55 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 207/621] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:52:55 2023] DELETE /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:55 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:52:55 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 HTTP/1.1 Apr 14 01:52:55 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:52:55 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:52:55 user devstack@n-api.service[61837]: Connection: close Apr 14 01:52:55 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:52:55 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:52:55 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:52:55 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:52:55 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:55 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:55 user devstack@n-api.service[61837]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:55 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:52:55 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:52:55 user devstack@n-api.service[61837]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:52:55 user devstack@n-api.service[61837]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:55 user devstack@n-api.service[61837]: method: > Apr 14 01:52:55 user devstack@n-api.service[61837]: exception: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61837]: action_args: {'id': 'e9be81ce-9ccc-4557-9763-33984b2c6573'} Apr 14 01:52:55 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. Apr 14 01:52:55 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:52:55 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance e9be81ce-9ccc-4557-9763-33984b2c6573 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:52:55 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-38b62c77-2afc-48f5-9518-cff9d6992d7a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573" status: 404 len: 111 microversion: 2.1 time: 0.026783 Apr 14 01:52:55 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 206/622] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:52:55 2023] GET /compute/v2.1/servers/e9be81ce-9ccc-4557-9763-33984b2c6573 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:56 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:52:56 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 HTTP/1.1 Apr 14 01:52:56 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:52:56 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:52:56 user devstack@n-api.service[61836]: Connection: close Apr 14 01:52:56 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:52:56 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:52:56 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:52:56 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:52:56 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:56 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:56 user devstack@n-api.service[61836]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:56 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:52:56 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:52:56 user devstack@n-api.service[61836]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:52:56 user devstack@n-api.service[61836]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:56 user devstack@n-api.service[61836]: method: > Apr 14 01:52:56 user devstack@n-api.service[61836]: exception: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61836]: action_args: {'id': '1ccf53b5-9199-4812-a635-4f4f22fb5d28'} Apr 14 01:52:56 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:52:56 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-cf469b63-6396-438e-9b83-109ebcdcb262 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28" status: 404 len: 111 microversion: 2.1 time: 0.027913 Apr 14 01:52:56 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 210/623] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:52:56 2023] DELETE /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:52:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:52:56 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 HTTP/1.1 Apr 14 01:52:56 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:52:56 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:52:56 user devstack@n-api.service[61835]: Connection: close Apr 14 01:52:56 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:52:56 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:52:56 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:52:56 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:52:56 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:52:56 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:52:56 user devstack@n-api.service[61835]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:56 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:52:56 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:52:56 user devstack@n-api.service[61835]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:52:56 user devstack@n-api.service[61835]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:52:56 user devstack@n-api.service[61835]: method: > Apr 14 01:52:56 user devstack@n-api.service[61835]: exception: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61835]: action_args: {'id': '1ccf53b5-9199-4812-a635-4f4f22fb5d28'} Apr 14 01:52:56 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. Apr 14 01:52:56 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:52:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:52:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f20e4cd1-5e49-435f-b7a2-c23030184c6a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28" status: 404 len: 111 microversion: 2.1 time: 0.028478 Apr 14 01:52:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 208/624] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:52:56 2023] GET /compute/v2.1/servers/1ccf53b5-9199-4812-a635-4f4f22fb5d28 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:52:56 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-02a7edba-c857-4f47-b8e8-3f1cf829bae6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Action: 'create', calling method: .version_select at 0x7fd420f943a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-824995165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg=="}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:52:56 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-02a7edba-c857-4f47-b8e8-3f1cf829bae6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:52:56 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-02a7edba-c857-4f47-b8e8-3f1cf829bae6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for user 50e3354ac1a84c59a7dee8e1ae6e771a and project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:52:56 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-02a7edba-c857-4f47-b8e8-3f1cf829bae6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.050972 Apr 14 01:52:56 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 207/625] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:52:56 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] Creating event network-changed:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:53:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027900 Apr 14 01:53:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 211/626] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:53:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1737844387", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-824995165", "security_groups": [{"name": "tempest-secgroup-smoke-650924684"}], "block_device_mapping_v2": [{"uuid": "450914a2-96ae-4c21-a717-2b391be59860", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "74c65fc2-ff90-46a4-a5e1-300009f92343"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] validate_networks() for [('74c65fc2-ff90-46a4-a5e1-300009f92343', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for user 50e3354ac1a84c59a7dee8e1ae6e771a and project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:53:01 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='450914a2-96ae-4c21-a717-2b391be59860',volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:53:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.902954 Apr 14 01:53:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 209/627] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:53:01 2023] POST /compute/v2.1/servers => generated 403 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:53:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-92ac84f9-6b72-4c68-8276-d6c33939a9b4 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:02 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-92ac84f9-6b72-4c68-8276-d6c33939a9b4 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:02 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-92ac84f9-6b72-4c68-8276-d6c33939a9b4 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-92ac84f9-6b72-4c68-8276-d6c33939a9b4 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f" status: 200 len: 1089 microversion: 2.1 time: 0.061720 Apr 14 01:53:02 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 208/628] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:53:02 2023] GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f => generated 1089 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:53:02 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-803cae99-be17-450d-b7df-6d3f6c835db3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:02 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-803cae99-be17-450d-b7df-6d3f6c835db3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-803cae99-be17-450d-b7df-6d3f6c835db3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-803cae99-be17-450d-b7df-6d3f6c835db3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-803cae99-be17-450d-b7df-6d3f6c835db3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-803cae99-be17-450d-b7df-6d3f6c835db3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-803cae99-be17-450d-b7df-6d3f6c835db3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-803cae99-be17-450d-b7df-6d3f6c835db3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:02 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-803cae99-be17-450d-b7df-6d3f6c835db3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049171 Apr 14 01:53:02 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 212/629] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:53:02 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:53:03 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:03 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:03 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:03 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-507dbf60-5179-4360-bf96-5ddb7387854b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1675 microversion: 2.1 time: 0.145207 Apr 14 01:53:03 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 210/630] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:53:03 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:53:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:03 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:03 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-fefebfb6-fdf8-4cfc-9648-b004d0e44426 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1675 microversion: 2.1 time: 0.182054 Apr 14 01:53:03 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 209/631] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:53:03 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:53:03 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:03 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:03 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:03 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:03 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-134266fa-d171-4394-b7db-b92e0e19c1a0 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1675 microversion: 2.1 time: 0.151453 Apr 14 01:53:03 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 213/632] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:53:03 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:05 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-215c3148-6538-4f3c-99ff-5ad8ee2ab161 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" status: 200 len: 1768 microversion: 2.87 time: 0.265244 Apr 14 01:53:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 211/633] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:53:05 2023] GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => generated 1768 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:53:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410c2004-b2c8-4274-b1d3-9b48585c644f", "tag": "369a4435-3639-47bc-8a63-1c6c3f25df9b"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] Creating event network-changed:369a4435-3639-47bc-8a63-1c6c3f25df9b for instance 410c2004-b2c8-4274-b1d3-9b48585c644f on user Apr 14 01:53:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048975 Apr 14 01:53:05 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 210/634] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:09 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "name": "network-vif-plugged", "status": "completed", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:09 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] Creating event network-vif-plugged:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:53:09 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031354 Apr 14 01:53:09 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 214/635] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:53:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "name": "network-vif-plugged", "status": "completed", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] Creating event network-vif-plugged:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:53:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032163 Apr 14 01:53:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 212/636] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:53:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:11 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410c2004-b2c8-4274-b1d3-9b48585c644f", "name": "network-vif-plugged", "status": "completed", "tag": "369a4435-3639-47bc-8a63-1c6c3f25df9b"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:11 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:11 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] Creating event network-vif-plugged:369a4435-3639-47bc-8a63-1c6c3f25df9b for instance 410c2004-b2c8-4274-b1d3-9b48585c644f on user Apr 14 01:53:11 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037253 Apr 14 01:53:11 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 211/637] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:53:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:12 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] HTTP exception thrown: Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 could not be found. Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Request method failure captured: Apr 14 01:53:12 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800 HTTP/1.1 Apr 14 01:53:12 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:53:12 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:53:12 user devstack@n-api.service[61836]: Connection: close Apr 14 01:53:12 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:53:12 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:53:12 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:53:12 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:53:12 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLA_5EP-5mEYd-EMYxhuw_HuenvnEJ-uvIw2O-62rr9iq59F5jgb13Q5r02Smu4R9N5weAmTIPoUg1RpTRntaD7K9v989cT5NWmIgHPzZDJTEVSFREw-Pdp_gyBYt246qV5I-bAFh8sagvP71dmSA1gAQR_kiGQ6hKDUJujjA_6raHY Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Project-Id: 740488dbb5114fb2b38be20f8ce4adb0 Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Project-Name: tempest-SnapshotDataIntegrityTests-919714320 Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/740488dbb5114fb2b38be20f8ce4adb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/740488dbb5114fb2b38be20f8ce4adb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/740488dbb5114fb2b38be20f8ce4adb0"}]}] Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Tenant: tempest-SnapshotDataIntegrityTests-919714320 Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Tenant-Id: 740488dbb5114fb2b38be20f8ce4adb0 Apr 14 01:53:12 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-919714320 Apr 14 01:53:12 user devstack@n-api.service[61836]: X-User: tempest-SnapshotDataIntegrityTests-919714320-project-member Apr 14 01:53:12 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:53:12 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:53:12 user devstack@n-api.service[61836]: X-User-Id: 34e25e45353e40b9a8bb14736c03fdeb Apr 14 01:53:12 user devstack@n-api.service[61836]: X-User-Name: tempest-SnapshotDataIntegrityTests-919714320-project-member Apr 14 01:53:12 user devstack@n-api.service[61836]: method: > Apr 14 01:53:12 user devstack@n-api.service[61836]: exception: Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 could not be found. Apr 14 01:53:12 user devstack@n-api.service[61836]: action_args: {'id': '74311da6-d6b8-4aea-b6ce-97db8da53800'} Apr 14 01:53:12 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 could not be found. Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 could not be found. Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 could not be found. Apr 14 01:53:12 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:53:12 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Returning 404 to user: Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:53:12 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-a9e8885c-d500-4856-a46c-549366a1e2ed tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800" status: 404 len: 111 microversion: 2.1 time: 0.029640 Apr 14 01:53:12 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 215/638] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:53:12 2023] GET /compute/v2.1/servers/74311da6-d6b8-4aea-b6ce-97db8da53800 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:53:12 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:12 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:12 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ddda9471-c370-430b-bf7f-b654d7540284 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Calling method '.version_select at 0x7fd420fb0700>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ddda9471-c370-430b-bf7f-b654d7540284 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-465819654" status: 202 len: 0 microversion: 2.1 time: 0.028667 Apr 14 01:53:12 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 213/639] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:53:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-465819654 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:53:13 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410c2004-b2c8-4274-b1d3-9b48585c644f", "name": "network-vif-plugged", "status": "completed", "tag": "369a4435-3639-47bc-8a63-1c6c3f25df9b"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:13 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:13 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] Creating event network-vif-plugged:369a4435-3639-47bc-8a63-1c6c3f25df9b for instance 410c2004-b2c8-4274-b1d3-9b48585c644f on user Apr 14 01:53:13 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045879 Apr 14 01:53:13 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 212/640] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:53:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=16 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:25 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:25 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-49a0eb74-dafb-4bc6-afca-40fd7c1b928f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1689 microversion: 2.1 time: 0.166780 Apr 14 01:53:25 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 216/641] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:53:25 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:53:36 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:36 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2a248ac1-35f3-497c-a3b5-22ab0fc6366d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'create', calling method: .version_select at 0x7fd421e69090>, body: {"keypair": {"name": "tempest-keypair-843861517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+OdZSGBEkWqqj7kuDmKwl/+l4bHkD0nIQkpmr7DuvkGkz+hkeVv46cz6D3tLWZ7TOclqa0k/xgkvW1kl0/hacLGQfyoaWAHTyjX568DZBdMmvuK27rWMMV+9zvHM6h7g=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:36 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-2a248ac1-35f3-497c-a3b5-22ab0fc6366d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting quotas for project 6d3de04739384e3ea3a475fee28be3c0. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:53:36 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-2a248ac1-35f3-497c-a3b5-22ab0fc6366d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting quotas for user eeb5f26be86e43b3b61fff98fdc83cf3 and project 6d3de04739384e3ea3a475fee28be3c0. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:53:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2a248ac1-35f3-497c-a3b5-22ab0fc6366d tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053879 Apr 14 01:53:36 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 214/642] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 01:53:36 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=20 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2091181391", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2c4fba9e-0217-4e37-af1c-065b3f0cd093"}], "security_groups": [{"name": "tempest-securitygroup--880536209"}], "key_name": "tempest-keypair-843861517", "user_data": "}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] validate_networks() for [('2c4fba9e-0217-4e37-af1c-065b3f0cd093', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting quotas for project 6d3de04739384e3ea3a475fee28be3c0. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting quotas for user eeb5f26be86e43b3b61fff98fdc83cf3 and project 6d3de04739384e3ea3a475fee28be3c0. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:53:38 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:53:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.591200 Apr 14 01:53:38 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 213/643] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:53:38 2023] POST /compute/v2.1/servers => generated 406 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:53:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d14bc288-f018-4190-b161-c249de53732f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:38 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d14bc288-f018-4190-b161-c249de53732f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:38 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:38 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:38 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d14bc288-f018-4190-b161-c249de53732f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d14bc288-f018-4190-b161-c249de53732f tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" status: 200 len: 1239 microversion: 2.1 time: 0.062584 Apr 14 01:53:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 217/644] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:53:38 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => generated 1239 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 01:53:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] Creating event network-changed:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:53:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030838 Apr 14 01:53:41 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 215/645] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:53:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:44 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:44 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:53:44 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041804 Apr 14 01:53:44 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 214/646] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:44 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:44 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f21a8c06-07f0-4602-b3d4-d1ee5c446f0a tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 200 len: 1784 microversion: 2.20 time: 0.161342 Apr 14 01:53:44 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 218/647] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:53:44 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 1784 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:53:46 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:53:46 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:46 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:46 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:46 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:53:46 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032595 Apr 14 01:53:46 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 216/648] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:53:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:53:52 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:53:52 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3ffb2204-0623-4d53-af44-f299547e19a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f" status: 200 len: 1440 microversion: 2.1 time: 0.154373 Apr 14 01:53:52 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 215/649] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:53:52 2023] GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f => generated 1440 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "0732ba1d-fc49-4c86-93b6-c5bd4572a1f9"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:05 user devstack@n-api.service[61836]: DEBUG nova.objects.instance [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'flavor' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=61836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:06 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/action" status: 200 len: 29 microversion: 2.87 time: 0.457632 Apr 14 01:54:06 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 219/650] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 01:54:05 2023] POST /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/action => generated 29 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=10 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:06 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:06 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-133cb4b4-9533-4653-b94a-38763c00a673 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1675 microversion: 2.1 time: 0.452271 Apr 14 01:54:06 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 217/651] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:54:06 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1675 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:54:06 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55aa3df5-b363-4e8f-ac2e-f46bea9ca67f"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:06 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:06 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:06 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d3a6bbae-abbf-4dfe-bffd-64a4062e0d6b tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" status: 200 len: 1774 microversion: 2.87 time: 0.278486 Apr 14 01:54:06 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 216/652] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:54:06 2023] GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => generated 1774 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:54:06 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277393 Apr 14 01:54:06 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 220/653] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:54:06 2023] POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-unplugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] Creating event network-vif-unplugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:54:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036065 Apr 14 01:54:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 218/654] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:09 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-plugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] Creating event network-vif-plugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:54:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028524 Apr 14 01:54:09 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 217/655] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:11 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-plugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] Creating event network-vif-plugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:54:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044317 Apr 14 01:54:11 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 221/656] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:54:13 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-plugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] Creating event network-vif-plugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:54:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034548 Apr 14 01:54:13 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 219/657] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Old instance type m1.nano, new instance type m1.micro {{(pid=61837) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for user 78ccd1a1ec1b486981d850881734fe02 and project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:54:14 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:54:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/action" status: 202 len: 0 microversion: 2.1 time: 0.360416 Apr 14 01:54:14 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 218/658] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:54:14 2023] POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:54:14 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:14 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:14 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-a824b805-1561-405a-ab51-4bf40bb08486 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1730 microversion: 2.1 time: 0.195075 Apr 14 01:54:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 222/659] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:54:14 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:54:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-unplugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] Creating event network-vif-unplugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:54:17 user devstack@n-api.service[61835]: DEBUG nova.compute.api [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61835) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 01:54:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049262 Apr 14 01:54:17 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 220/660] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:54:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61837) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 01:54:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059522 Apr 14 01:54:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 219/661] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:25 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:25 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:25 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:25 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Going to try to start instance {{(pid=61836) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 01:54:25 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/action" status: 202 len: 0 microversion: 2.1 time: 0.112360 Apr 14 01:54:25 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 223/662] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:54:25 2023] POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:54:25 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:25 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:25 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:25 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-24766824-61a7-4b18-9711-5f25e5792c09 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1698 microversion: 2.1 time: 0.203940 Apr 14 01:54:25 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 221/663] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:54:25 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1698 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:54:28 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:28 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:54:28 user devstack@n-api.service[61837]: DEBUG nova.compute.api [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61837) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 01:54:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043164 Apr 14 01:54:28 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 220/664] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:28 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:28 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:29 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e51484ad-3ac7-4677-9fb1-cf87acca1021 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" status: 200 len: 1553 microversion: 2.1 time: 0.153363 Apr 14 01:54:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 224/665] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:54:28 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:54:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:54:30 user devstack@n-api.service[61835]: DEBUG nova.compute.api [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61835) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 01:54:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039973 Apr 14 01:54:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 222/666] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:32 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-plugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}, {"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-plugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Creating event network-vif-plugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:54:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Creating event network-vif-plugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:54:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042686 Apr 14 01:54:32 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 221/667] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-2931c70a-7d81-41de-b986-ff7a1bab6cff tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-2931c70a-7d81-41de-b986-ff7a1bab6cff tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2931c70a-7d81-41de-b986-ff7a1bab6cff tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2931c70a-7d81-41de-b986-ff7a1bab6cff tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2931c70a-7d81-41de-b986-ff7a1bab6cff tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2931c70a-7d81-41de-b986-ff7a1bab6cff tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2931c70a-7d81-41de-b986-ff7a1bab6cff tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-2931c70a-7d81-41de-b986-ff7a1bab6cff tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:44 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-2931c70a-7d81-41de-b986-ff7a1bab6cff tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments/26c6e12f-4381-4acd-a6e5-a979a6886f25" status: 200 len: 194 microversion: 2.20 time: 0.211199 Apr 14 01:54:44 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 225/668] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 01:54:44 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments/26c6e12f-4381-4acd-a6e5-a979a6886f25 => generated 194 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=12 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=24 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:44 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'services' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:54:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments/26c6e12f-4381-4acd-a6e5-a979a6886f25" status: 202 len: 0 microversion: 2.20 time: 0.213515 Apr 14 01:54:44 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 223/669] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 01:54:44 2023] DELETE /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments/26c6e12f-4381-4acd-a6e5-a979a6886f25 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=26 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-aaed4656-d016-4a13-9c90-f412fd298477 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-aaed4656-d016-4a13-9c90-f412fd298477 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aaed4656-d016-4a13-9c90-f412fd298477 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aaed4656-d016-4a13-9c90-f412fd298477 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aaed4656-d016-4a13-9c90-f412fd298477 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aaed4656-d016-4a13-9c90-f412fd298477 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aaed4656-d016-4a13-9c90-f412fd298477 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aaed4656-d016-4a13-9c90-f412fd298477 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-aaed4656-d016-4a13-9c90-f412fd298477 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056633 Apr 14 01:54:45 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 222/670] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 01:54:44 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:54:52 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:52 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:52 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:52 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-6e586294-2a45-4f15-a8da-95d61dd9a100 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f" status: 200 len: 1440 microversion: 2.1 time: 0.294787 Apr 14 01:54:52 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 226/671] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:54:52 2023] GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f => generated 1440 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:54:54 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:54:54 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410c2004-b2c8-4274-b1d3-9b48585c644f", "tag": "369a4435-3639-47bc-8a63-1c6c3f25df9b"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:54 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:54 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:54 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:54 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] Creating event network-changed:369a4435-3639-47bc-8a63-1c6c3f25df9b for instance 410c2004-b2c8-4274-b1d3-9b48585c644f on user Apr 14 01:54:54 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035913 Apr 14 01:54:54 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 224/672] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:54 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:54 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:54 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:54:55 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f" status: 204 len: 0 microversion: 2.1 time: 0.118055 Apr 14 01:54:55 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 223/673] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:54:54 2023] DELETE /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:54:55 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:55 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:55 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:55 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e4949948-c8f1-4bcb-a020-b8203c4c0bdd tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f" status: 200 len: 1446 microversion: 2.1 time: 0.187971 Apr 14 01:54:55 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 227/674] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:54:55 2023] GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f => generated 1446 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:54:55 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410c2004-b2c8-4274-b1d3-9b48585c644f", "name": "network-vif-unplugged", "status": "completed", "tag": "369a4435-3639-47bc-8a63-1c6c3f25df9b"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:55 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] Creating event network-vif-unplugged:369a4435-3639-47bc-8a63-1c6c3f25df9b for instance 410c2004-b2c8-4274-b1d3-9b48585c644f on user Apr 14 01:54:55 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030478 Apr 14 01:54:55 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 225/675] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:56 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:54:56 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-aad93529-0c21-4e34-84c0-659e01706ebc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" status: 200 len: 1754 microversion: 2.87 time: 0.233923 Apr 14 01:54:56 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 224/676] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:54:56 2023] GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => generated 1754 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:54:57 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410c2004-b2c8-4274-b1d3-9b48585c644f", "name": "network-vif-plugged", "status": "completed", "tag": "369a4435-3639-47bc-8a63-1c6c3f25df9b"}, {"server_uuid": "410c2004-b2c8-4274-b1d3-9b48585c644f", "name": "network-vif-deleted", "tag": "369a4435-3639-47bc-8a63-1c6c3f25df9b"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:54:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:54:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:54:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:54:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] Creating event network-vif-plugged:369a4435-3639-47bc-8a63-1c6c3f25df9b for instance 410c2004-b2c8-4274-b1d3-9b48585c644f on user Apr 14 01:54:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] Creating event network-vif-deleted:369a4435-3639-47bc-8a63-1c6c3f25df9b for instance 410c2004-b2c8-4274-b1d3-9b48585c644f on user Apr 14 01:54:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038508 Apr 14 01:54:57 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 228/677] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:54:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:05 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:05 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-74d2c285-62cb-44c0-b05f-c11c8f44db94 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1729 microversion: 2.1 time: 0.170412 Apr 14 01:55:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 226/678] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:55:05 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-084ac489-d6d1-4457-9623-d54b60e965ce tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1702 microversion: 2.1 time: 0.152242 Apr 14 01:55:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 225/679] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:55:15 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1702 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=20 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-113f3467-80df-4fc9-9200-dcb9736d443e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-113f3467-80df-4fc9-9200-dcb9736d443e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-113f3467-80df-4fc9-9200-dcb9736d443e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-113f3467-80df-4fc9-9200-dcb9736d443e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-113f3467-80df-4fc9-9200-dcb9736d443e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-113f3467-80df-4fc9-9200-dcb9736d443e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-113f3467-80df-4fc9-9200-dcb9736d443e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-113f3467-80df-4fc9-9200-dcb9736d443e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-113f3467-80df-4fc9-9200-dcb9736d443e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.128266 Apr 14 01:55:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 229/680] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:55:29 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-interface => generated 283 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:30 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:30 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] Creating event network-changed:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:55:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032966 Apr 14 01:55:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 227/681] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c279a98-9587-47a8-a153-408cc1232415"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279945 Apr 14 01:55:30 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 226/682] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 01:55:30 2023] POST /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-30358b6a-3f74-4685-afe6-3f83cadfc9e2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-30358b6a-3f74-4685-afe6-3f83cadfc9e2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-30358b6a-3f74-4685-afe6-3f83cadfc9e2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-30358b6a-3f74-4685-afe6-3f83cadfc9e2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-30358b6a-3f74-4685-afe6-3f83cadfc9e2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-30358b6a-3f74-4685-afe6-3f83cadfc9e2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-30358b6a-3f74-4685-afe6-3f83cadfc9e2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-30358b6a-3f74-4685-afe6-3f83cadfc9e2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-30358b6a-3f74-4685-afe6-3f83cadfc9e2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045702 Apr 14 01:55:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 230/683] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 01:55:35 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:55:35 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:35 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:35 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:55:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 204 len: 0 microversion: 2.20 time: 0.124960 Apr 14 01:55:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 228/684] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:55:35 2023] DELETE /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "name": "network-vif-unplugged", "status": "completed", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:35 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-cf84aa9c-baee-4b57-aa1e-e9edad7ccd1c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 200 len: 1712 microversion: 2.20 time: 0.263374 Apr 14 01:55:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 227/685] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:55:35 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 1712 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] Creating event network-vif-unplugged:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:55:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029443 Apr 14 01:55:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 231/686] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "name": "network-vif-deleted", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] Creating event network-vif-deleted:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:55:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Apr 14 01:55:36 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 229/687] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:37 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80", "name": "network-vif-plugged", "status": "completed", "tag": "db433bb1-8c59-4e6b-ae87-f6fab836df0f"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] Creating event network-vif-plugged:db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 on user Apr 14 01:55:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035519 Apr 14 01:55:37 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 228/688] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:38 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:38 user devstack@n-api.service[61836]: DEBUG nova.objects.instance [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'flavor' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=61836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:55:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/action" status: 200 len: 32 microversion: 2.1 time: 0.259585 Apr 14 01:55:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 232/689] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:55:38 2023] POST /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 01:55:38 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:38 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:38 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:38 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-0e52597c-edbf-4db3-b75c-49c467f4c040 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" status: 200 len: 1723 microversion: 2.1 time: 0.191431 Apr 14 01:55:38 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 230/690] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:55:38 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:55:39 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-unplugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:39 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] Creating event network-vif-unplugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:55:39 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045280 Apr 14 01:55:39 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 229/691] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:55:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031269 Apr 14 01:55:41 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 233/692] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}, {"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:55:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:55:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029647 Apr 14 01:55:43 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 231/693] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 01:55:45 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f HTTP/1.1 Apr 14 01:55:45 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:55:45 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:55:45 user devstack@n-api.service[61837]: Connection: close Apr 14 01:55:45 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:55:45 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:55:45 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:55:45 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:55:45 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 01:55:45 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 01:55:45 user devstack@n-api.service[61837]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:55:45 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:55:45 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:55:45 user devstack@n-api.service[61837]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 01:55:45 user devstack@n-api.service[61837]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 01:55:45 user devstack@n-api.service[61837]: method: > Apr 14 01:55:45 user devstack@n-api.service[61837]: exception: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 01:55:45 user devstack@n-api.service[61837]: action_args: {'id': '410c2004-b2c8-4274-b1d3-9b48585c644f'} Apr 14 01:55:45 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 01:55:45 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:55:45 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:55:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d6a3c5e9-c94b-402b-99f8-297f62cbe1c5 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f" status: 404 len: 111 microversion: 2.1 time: 0.036431 Apr 14 01:55:45 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 230/694] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:55:45 2023] GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:55:45 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1218439158", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-824995165", "security_groups": [{"name": "tempest-secgroup-smoke-650924684"}], "block_device_mapping_v2": [{"uuid": "450914a2-96ae-4c21-a717-2b391be59860", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "74c65fc2-ff90-46a4-a5e1-300009f92343"}]}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:45 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] validate_networks() for [('74c65fc2-ff90-46a4-a5e1-300009f92343', None, None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for user 50e3354ac1a84c59a7dee8e1ae6e771a and project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:55:46 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='450914a2-96ae-4c21-a717-2b391be59860',volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:55:46 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.818444 Apr 14 01:55:46 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 234/695] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:55:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:55:46 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-8e4d4fb5-f24b-40c9-8a3e-2366b8fc42c3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:46 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-8e4d4fb5-f24b-40c9-8a3e-2366b8fc42c3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:46 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-8e4d4fb5-f24b-40c9-8a3e-2366b8fc42c3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:46 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-8e4d4fb5-f24b-40c9-8a3e-2366b8fc42c3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f" status: 200 len: 1089 microversion: 2.1 time: 0.124899 Apr 14 01:55:46 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 232/696] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:55:46 2023] GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f => generated 1089 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:55:49 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618f5f0d-3594-41dd-9d8f-0c7bea255a3f", "tag": "7eb65ace-3427-4415-a8ef-26064243471e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:49 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:49 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:49 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:49 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] Creating event network-changed:7eb65ace-3427-4415-a8ef-26064243471e for instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f on user Apr 14 01:55:49 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031582 Apr 14 01:55:49 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 231/697] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:56 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/action" status: 202 len: 0 microversion: 2.87 time: 0.082047 Apr 14 01:55:56 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 235/698] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 01:55:56 2023] POST /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:55:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:55:56 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:55:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:55:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:57 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618f5f0d-3594-41dd-9d8f-0c7bea255a3f", "name": "network-vif-plugged", "status": "completed", "tag": "7eb65ace-3427-4415-a8ef-26064243471e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:57 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:57 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] Creating event network-vif-plugged:7eb65ace-3427-4415-a8ef-26064243471e for instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f on user Apr 14 01:55:57 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:57 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:55:57 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038089 Apr 14 01:55:57 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 232/699] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:57 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-fe89f85a-53c2-4e94-8596-5eac58684204 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" status: 200 len: 1762 microversion: 2.87 time: 0.419492 Apr 14 01:55:57 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 233/700] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:55:56 2023] GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => generated 1762 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:55:57 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-unplugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] Creating event network-vif-unplugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:55:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030006 Apr 14 01:55:57 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 236/701] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:59 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618f5f0d-3594-41dd-9d8f-0c7bea255a3f", "name": "network-vif-plugged", "status": "completed", "tag": "7eb65ace-3427-4415-a8ef-26064243471e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] Creating event network-vif-plugged:7eb65ace-3427-4415-a8ef-26064243471e for instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f on user Apr 14 01:55:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033513 Apr 14 01:55:59 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 233/702] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:55:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-plugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}, {"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-plugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:55:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:55:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:55:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:55:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Creating event network-vif-plugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:55:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Creating event network-vif-plugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:55:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034563 Apr 14 01:55:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 234/703] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:55:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:02 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-plugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:02 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:02 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] Creating event network-vif-plugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:56:02 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030696 Apr 14 01:56:02 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 237/704] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:56:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=17 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:05 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/action" status: 202 len: 0 microversion: 2.1 time: 0.180006 Apr 14 01:56:05 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 234/705] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:56:05 2023] POST /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:56:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:05 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:05 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-290f7ee0-5803-4f9e-b71f-0c9c50088e45 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1728 microversion: 2.1 time: 0.401838 Apr 14 01:56:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 235/706] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:56:05 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1728 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:56:06 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-unplugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:06 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] Creating event network-vif-unplugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:56:06 user devstack@n-api.service[61836]: DEBUG nova.compute.api [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61836) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 01:56:06 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103061 Apr 14 01:56:06 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 238/707] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:56:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:09 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:56:09 user devstack@n-api.service[61837]: DEBUG nova.compute.api [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61837) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 01:56:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036372 Apr 14 01:56:09 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 235/708] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:56:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=14 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:16 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'services' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:56:16 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/os-volume_attachments/4d2a082d-59f8-4081-9ace-fc3ae1219b10" status: 202 len: 0 microversion: 2.1 time: 0.305734 Apr 14 01:56:16 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 236/709] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:56:16 2023] DELETE /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/os-volume_attachments/4d2a082d-59f8-4081-9ace-fc3ae1219b10 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:56:17 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:17 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:56:17 user devstack@n-api.service[61836]: DEBUG nova.compute.api [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61836) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 01:56:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048586 Apr 14 01:56:17 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 239/710] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:56:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Going to try to stop instance {{(pid=61837) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 01:56:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/action" status: 202 len: 0 microversion: 2.1 time: 0.087817 Apr 14 01:56:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 236/711] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:56:19 2023] POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:56:19 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:19 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:19 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:19 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:56:19 user devstack@n-api.service[61836]: DEBUG nova.compute.api [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61836) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 01:56:19 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046056 Apr 14 01:56:19 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 240/712] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:56:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:20 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-47f5b7d3-c139-4637-85cd-099c4d922f1c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1666 microversion: 2.1 time: 0.182766 Apr 14 01:56:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 237/713] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:56:19 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1666 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:56:21 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-unplugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}, {"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-plugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Creating event network-vif-unplugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:56:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Creating event network-vif-plugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:56:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035361 Apr 14 01:56:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 237/714] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:56:21 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:25 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] HTTP exception thrown: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Request method failure captured: Apr 14 01:56:25 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 HTTP/1.1 Apr 14 01:56:25 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:56:25 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:56:25 user devstack@n-api.service[61836]: Connection: close Apr 14 01:56:25 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:56:25 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:56:25 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:56:25 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:56:25 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLESjFhKG88rLDkmHrqgOJCWkMLjw5tkdR2QSGJfas1kpAouNy_OOp95xzeBrsiyUyzu9EsCTdTm27qQ9BBh9nKD9dNrpGKgvxr5fZVK_jptAggg2sJymOLPiGjgNS-KDPe7oze1h_WjICjAyGUkt3cTz1uVOtSb24dL-6jqrDJL-k0 Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Project-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}] Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Tenant-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 01:56:25 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 01:56:25 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 01:56:25 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:56:25 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:56:25 user devstack@n-api.service[61836]: X-User-Id: 2a5da3e233c74524a953ce0d4e074077 Apr 14 01:56:25 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 01:56:25 user devstack@n-api.service[61836]: method: > Apr 14 01:56:25 user devstack@n-api.service[61836]: exception: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 01:56:25 user devstack@n-api.service[61836]: action_args: {'id': '18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80'} Apr 14 01:56:25 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 01:56:25 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:56:25 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Returning 404 to user: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:56:25 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4b456de3-0f80-46af-9e44-d20e79eb4b47 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 404 len: 111 microversion: 2.20 time: 0.067487 Apr 14 01:56:25 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 241/715] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:56:25 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:56:25 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5bdb9662-5fb6-443b-9408-8e5659558b27 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '.version_select at 0x7fd420e285e0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:25 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5bdb9662-5fb6-443b-9408-8e5659558b27 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472759355" status: 204 len: 0 microversion: 2.20 time: 0.033064 Apr 14 01:56:25 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 238/716] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 01:56:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472759355 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:56:26 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-63f1a998-bd11-4ddb-9e45-b32adba93926 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'create', calling method: .version_select at 0x7fd420cd3250>, body: {"keypair": {"name": "tempest-keypair-1419165173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIopxcmtvU7zv42zkIa4Oz1jEP4DNyyAzFY9+vRTU16RetxI5ZPVi+sg5XXxOyu9RTbP8T9qWJjnsbfeLu0C5tcKuN56PwVxP5mYkQsJP0kN6YvWI8oVts6rIeLy1vmUYw=="}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:26 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-63f1a998-bd11-4ddb-9e45-b32adba93926 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting quotas for project a6d05ca328d64f2aa1d19550475edba3. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:56:26 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-63f1a998-bd11-4ddb-9e45-b32adba93926 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting quotas for user 2a5da3e233c74524a953ce0d4e074077 and project a6d05ca328d64f2aa1d19550475edba3. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:56:26 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-63f1a998-bd11-4ddb-9e45-b32adba93926 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050831 Apr 14 01:56:26 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 238/717] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 01:56:26 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1283417408", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a7b6c0bc-d2de-4431-821b-c2917738e556"}], "security_groups": [{"name": "tempest-securitygroup--1363099852"}], "key_name": "tempest-keypair-1419165173", "user_data": "}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] validate_networks() for [('a7b6c0bc-d2de-4431-821b-c2917738e556', None, None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting quotas for project a6d05ca328d64f2aa1d19550475edba3. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting quotas for user 2a5da3e233c74524a953ce0d4e074077 and project a6d05ca328d64f2aa1d19550475edba3. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:56:28 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:56:28 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.523770 Apr 14 01:56:28 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 242/718] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 01:56:28 2023] POST /compute/v2.1/servers => generated 400 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 01:56:28 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-44e5fb7a-b497-4a03-a126-033744998d2e tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:28 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-44e5fb7a-b497-4a03-a126-033744998d2e tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:28 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:28 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:28 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-44e5fb7a-b497-4a03-a126-033744998d2e tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:28 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-44e5fb7a-b497-4a03-a126-033744998d2e tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:28 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-44e5fb7a-b497-4a03-a126-033744998d2e tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-44e5fb7a-b497-4a03-a126-033744998d2e tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 200 len: 1276 microversion: 2.20 time: 0.080713 Apr 14 01:56:28 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 239/719] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:56:28 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 1276 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:56:28 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:28 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-4e35c83f-737d-4bc9-b50b-652a9e640101 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" status: 200 len: 1703 microversion: 2.1 time: 0.268367 Apr 14 01:56:28 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 239/720] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:56:28 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => generated 1703 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:56:31 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:31 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] Creating event network-changed:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 01:56:31 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124737 Apr 14 01:56:31 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 243/721] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:56:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:34 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "name": "network-vif-plugged", "status": "completed", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] Creating event network-vif-plugged:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 01:56:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040158 Apr 14 01:56:34 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 240/722] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:56:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "name": "network-vif-plugged", "status": "completed", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:56:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] Creating event network-vif-plugged:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 01:56:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031968 Apr 14 01:56:36 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 240/723] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:56:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:56:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:36 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:36 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d7e95ba8-5cd7-45e3-a2a5-bf4af45d132f tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f" status: 200 len: 1441 microversion: 2.1 time: 0.168897 Apr 14 01:56:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 244/724] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:56:36 2023] GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f => generated 1441 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:47 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:47 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-38ce404d-100f-4610-85a6-d9cffbb76590 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" status: 200 len: 1768 microversion: 2.87 time: 0.180327 Apr 14 01:56:47 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 241/725] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:56:47 2023] GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => generated 1768 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:56:55 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:55 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:56:55 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:56:56 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:56:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:56:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:56:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:56:56 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:56:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-89deb808-3aaa-4912-bb26-42ce6e08bfc9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1721 microversion: 2.1 time: 0.173263 Apr 14 01:56:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 241/726] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:56:55 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=20 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:10 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d2721858-3842-4b7a-bfae-f85c3b972cd3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1643 microversion: 2.1 time: 0.161747 Apr 14 01:57:10 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 245/727] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:57:10 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1643 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:18 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:18 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e062ba37-fb93-45fa-a659-a120fd447d8d tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 200 len: 1587 microversion: 2.20 time: 0.174909 Apr 14 01:57:18 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 242/728] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:57:18 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 1587 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 while it is in vm_state rescued Apr 14 01:57:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Request method failure captured: Apr 14 01:57:29 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments/4c279a98-9587-47a8-a153-408cc1232415 HTTP/1.1 Apr 14 01:57:29 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:57:29 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:57:29 user devstack@n-api.service[61835]: Connection: close Apr 14 01:57:29 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:57:29 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:57:29 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:57:29 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:57:29 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLAimNIpGvJxJ2K7x8_hYJlXVV3qbjMTDXN3Xm447JCUfxZDn-Wf0sl4YUvlfGEuUHZqEnw9ZwrHlGRKKi38xTuTU3GwUFRksR_fDEaBtrl_61Nk7ZcffAI89Uw3GQZ3tj6UHny8Z7R-nkYcye6xq1TYYcwo_Vs_FB25z0QmbgeF8b0 Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Project-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}] Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Tenant-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 01:57:29 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 01:57:29 user devstack@n-api.service[61835]: X-User: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 01:57:29 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:57:29 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:57:29 user devstack@n-api.service[61835]: X-User-Id: eeb5f26be86e43b3b61fff98fdc83cf3 Apr 14 01:57:29 user devstack@n-api.service[61835]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 01:57:29 user devstack@n-api.service[61835]: method: > Apr 14 01:57:29 user devstack@n-api.service[61835]: exception: Cannot 'detach_volume' instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 while it is in vm_state rescued Apr 14 01:57:29 user devstack@n-api.service[61835]: action_args: {'server_id': '92e640b7-a222-4b2f-8d9f-7151cfc7dcc7', 'id': '4c279a98-9587-47a8-a153-408cc1232415'} Apr 14 01:57:29 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 while it is in vm_state rescued Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 while it is in vm_state rescued Apr 14 01:57:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:57:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Returning 409 to user: Cannot 'detach_volume' instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 while it is in vm_state rescued {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:57:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-092b4da4-e13d-43f9-963d-1745b80c4bf6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments/4c279a98-9587-47a8-a153-408cc1232415" status: 409 len: 152 microversion: 2.1 time: 0.104867 Apr 14 01:57:29 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 242/729] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:57:28 2023] DELETE /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments/4c279a98-9587-47a8-a153-408cc1232415 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/action" status: 202 len: 0 microversion: 2.1 time: 0.075513 Apr 14 01:57:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 246/730] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:57:29 2023] POST /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:29 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-0b6d5770-8b00-49f4-ac34-8b06cd701aa6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" status: 200 len: 1711 microversion: 2.1 time: 0.228243 Apr 14 01:57:29 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 243/731] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:57:29 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => generated 1711 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:57:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-unplugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] Creating event network-vif-unplugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:57:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035280 Apr 14 01:57:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 243/732] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:57:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:57:32 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}, {"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}, {"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}, {"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-unplugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}, {"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}, {"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:57:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:57:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:57:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Creating event network-vif-unplugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:57:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:57:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:57:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.054707 Apr 14 01:57:32 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 247/733] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:57:32 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 01:57:34 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:57:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040841 Apr 14 01:57:34 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 244/734] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:57:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:57:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:36 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:36 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-bb8c773b-d78e-404d-b57b-b6deb34e4a5a tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f" status: 200 len: 1441 microversion: 2.1 time: 0.190516 Apr 14 01:57:36 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 244/735] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:57:36 2023] GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f => generated 1441 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:57:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618f5f0d-3594-41dd-9d8f-0c7bea255a3f", "tag": "7eb65ace-3427-4415-a8ef-26064243471e"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] Creating event network-changed:7eb65ace-3427-4415-a8ef-26064243471e for instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f on user Apr 14 01:57:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028275 Apr 14 01:57:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 248/736] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:57:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:57:44 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:44 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=8 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:44 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-999984632", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-824995165", "security_groups": [{"name": "tempest-secgroup-smoke-650924684"}], "block_device_mapping_v2": [{"uuid": "fd2a58c4-4fc8-4aca-8654-ae325aec4e25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "74c65fc2-ff90-46a4-a5e1-300009f92343"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:44 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] validate_networks() for [('74c65fc2-ff90-46a4-a5e1-300009f92343', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting quotas for user 50e3354ac1a84c59a7dee8e1ae6e771a and project c1f4117a4adb4aa3b42951cf1fc84237. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:57:45 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd2a58c4-4fc8-4aca-8654-ae325aec4e25',volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:57:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.709689 Apr 14 01:57:45 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 245/737] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:57:44 2023] POST /compute/v2.1/servers => generated 403 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:57:45 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ba7a6de6-734c-4773-bdb3-9b0a2ff738a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:45 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ba7a6de6-734c-4773-bdb3-9b0a2ff738a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:45 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-ba7a6de6-734c-4773-bdb3-9b0a2ff738a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:45 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ba7a6de6-734c-4773-bdb3-9b0a2ff738a2 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329" status: 200 len: 1088 microversion: 2.1 time: 0.071636 Apr 14 01:57:45 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 245/738] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:57:45 2023] GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:57:47 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:47 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:47 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:57:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" status: 204 len: 0 microversion: 2.87 time: 0.239401 Apr 14 01:57:47 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 249/739] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:57:47 2023] DELETE /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:57:47 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:47 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:48 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:48 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:48 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-be68c0e6-1bbd-4854-bb41-6f7f5bc9f436 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" status: 200 len: 1774 microversion: 2.87 time: 0.331276 Apr 14 01:57:48 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 246/740] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:57:47 2023] GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => generated 1774 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:57:48 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81666244-a2a7-4ace-969d-a3a3d0128329", "tag": "d66c282d-74db-42ba-96f3-faf43ebc6d98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:48 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=14 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:48 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:48 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:48 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:48 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] Creating event network-changed:d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance 81666244-a2a7-4ace-969d-a3a3d0128329 on user Apr 14 01:57:48 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031778 Apr 14 01:57:48 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 246/741] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:57:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:57:49 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-deleted", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:49 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] Creating event network-vif-deleted:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:57:49 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029188 Apr 14 01:57:49 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 250/742] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:57:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 01:57:50 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-unplugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}, {"server_uuid": "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed", "name": "network-vif-plugged", "status": "completed", "tag": "6568fde8-2639-4cee-8527-e3ca028f42fd"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Creating event network-vif-unplugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:57:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Creating event network-vif-plugged:6568fde8-2639-4cee-8527-e3ca028f42fd for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed on user Apr 14 01:57:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.070940 Apr 14 01:57:50 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 247/743] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:57:50 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:57:54 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81666244-a2a7-4ace-969d-a3a3d0128329", "name": "network-vif-plugged", "status": "completed", "tag": "d66c282d-74db-42ba-96f3-faf43ebc6d98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:54 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:54 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:54 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:54 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] Creating event network-vif-plugged:d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance 81666244-a2a7-4ace-969d-a3a3d0128329 on user Apr 14 01:57:54 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104089 Apr 14 01:57:54 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 247/744] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:57:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:57:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:56 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:56 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:56 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c7fabcc6-752c-4eaa-b657-dbdde323d08d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1721 microversion: 2.1 time: 0.139174 Apr 14 01:57:56 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 251/745] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:57:56 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1721 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:56 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:57:56 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-2af3de04-5455-4979-86ce-d523ca91d81d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1721 microversion: 2.1 time: 0.166137 Apr 14 01:57:56 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 248/746] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:57:56 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:57:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81666244-a2a7-4ace-969d-a3a3d0128329", "name": "network-vif-plugged", "status": "completed", "tag": "d66c282d-74db-42ba-96f3-faf43ebc6d98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:57:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:57:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:57:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:57:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:57:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] Creating event network-vif-plugged:d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance 81666244-a2a7-4ace-969d-a3a3d0128329 on user Apr 14 01:57:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032188 Apr 14 01:57:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 248/747] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:57:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:10 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:10 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:10 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Going to try to start instance {{(pid=61836) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 01:58:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/action" status: 202 len: 0 microversion: 2.1 time: 0.076185 Apr 14 01:58:10 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 252/748] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 01:58:10 2023] POST /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=16 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:10 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-912887de-2ebb-446d-ab6f-ad3fe6b7418c tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1652 microversion: 2.1 time: 0.153803 Apr 14 01:58:10 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 249/749] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:58:10 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1652 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:58:13 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=16 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:13 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:13 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-plugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] Creating event network-vif-plugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:58:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037566 Apr 14 01:58:13 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 249/750] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-plugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] Creating event network-vif-plugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 01:58:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028975 Apr 14 01:58:15 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 253/751] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-1083474a-ec01-46b0-8fed-5a547a657216 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-1083474a-ec01-46b0-8fed-5a547a657216 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1083474a-ec01-46b0-8fed-5a547a657216 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1083474a-ec01-46b0-8fed-5a547a657216 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1083474a-ec01-46b0-8fed-5a547a657216 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1083474a-ec01-46b0-8fed-5a547a657216 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1083474a-ec01-46b0-8fed-5a547a657216 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1083474a-ec01-46b0-8fed-5a547a657216 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-1083474a-ec01-46b0-8fed-5a547a657216 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.090518 Apr 14 01:58:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 250/752] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 01:58:19 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/os-interface => generated 282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:58:19 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:19 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:19 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-7b0f5459-6da1-4ace-83a4-0484648ad4ee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" status: 200 len: 1717 microversion: 2.1 time: 0.211433 Apr 14 01:58:19 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 250/753] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:58:19 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => generated 1717 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:58:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] Creating event network-changed:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 01:58:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031038 Apr 14 01:58:20 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 254/754] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-02216883-760f-49de-a288-b4ded172f553 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:20 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-02216883-760f-49de-a288-b4ded172f553 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02216883-760f-49de-a288-b4ded172f553 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02216883-760f-49de-a288-b4ded172f553 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02216883-760f-49de-a288-b4ded172f553 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02216883-760f-49de-a288-b4ded172f553 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02216883-760f-49de-a288-b4ded172f553 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02216883-760f-49de-a288-b4ded172f553 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:20 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-02216883-760f-49de-a288-b4ded172f553 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/ips" status: 200 len: 109 microversion: 2.20 time: 0.038789 Apr 14 01:58:20 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 251/755] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 01:58:20 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 01:58:22 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:22 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:22 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'flavor' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:58:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/action" status: 202 len: 0 microversion: 2.20 time: 0.768837 Apr 14 01:58:23 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 251/756] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 01:58:22 2023] POST /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/action => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:23 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:23 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-28b3a1fe-fa9e-4aeb-b101-50e7343aa1f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 200 len: 1712 microversion: 2.20 time: 0.222360 Apr 14 01:58:23 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 255/757] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:58:23 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 1712 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:58:23 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "name": "network-vif-unplugged", "status": "completed", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:23 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:23 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:23 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:23 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] Creating event network-vif-unplugged:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 01:58:23 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048050 Apr 14 01:58:23 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 252/758] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:25 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "name": "network-vif-plugged", "status": "completed", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:25 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] Creating event network-vif-plugged:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 01:58:25 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033288 Apr 14 01:58:25 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 252/759] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:28 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:28 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] Creating event network-changed:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 01:58:28 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049593 Apr 14 01:58:28 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 256/760] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=8 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=16 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:35 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-2864a00b-f832-4a7f-bf10-3bd921f603bf tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329" status: 200 len: 1440 microversion: 2.1 time: 0.162301 Apr 14 01:58:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 253/761] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:58:35 2023] GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329 => generated 1440 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:38 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] HTTP exception thrown: Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed could not be found. Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Request method failure captured: Apr 14 01:58:38 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed HTTP/1.1 Apr 14 01:58:38 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:58:38 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:58:38 user devstack@n-api.service[61835]: Connection: close Apr 14 01:58:38 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:58:38 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:58:38 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:58:38 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:58:38 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK8YTacedubWAhS5rzw9JEaPTG6xragTyjkfiQpMHhqdPKL_vIFx7Oo0JcBunIx_gKjHSnOM3lGZ4EkV-RuKODkLPPDokoxlpPECSblRT_d9310zSanCDjB-AierWxHKALLBIh7z2dQ-4JeglItcl5hi6xs8sG_wjDrJggOpq61Yt2c Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Project-Id: 219c39c8299e46368012a947fdfbe5fd Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/219c39c8299e46368012a947fdfbe5fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/219c39c8299e46368012a947fdfbe5fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/219c39c8299e46368012a947fdfbe5fd"}]}] Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Tenant-Id: 219c39c8299e46368012a947fdfbe5fd Apr 14 01:58:38 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 01:58:38 user devstack@n-api.service[61835]: X-User: tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member Apr 14 01:58:38 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:58:38 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:58:38 user devstack@n-api.service[61835]: X-User-Id: 7ed01a83531f4c6bb18a4593284baf05 Apr 14 01:58:38 user devstack@n-api.service[61835]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member Apr 14 01:58:38 user devstack@n-api.service[61835]: method: > Apr 14 01:58:38 user devstack@n-api.service[61835]: exception: Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed could not be found. Apr 14 01:58:38 user devstack@n-api.service[61835]: action_args: {'id': '7ff438f4-54e1-44b9-bb5a-1b42d48a37ed'} Apr 14 01:58:38 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed could not be found. Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed could not be found. Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed could not be found. Apr 14 01:58:38 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Returning 404 to user: Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:58:38 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2549d8b0-28ce-4ba3-836a-f8ef3fbd4702 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" status: 404 len: 111 microversion: 2.87 time: 0.036692 Apr 14 01:58:38 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 253/762] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:58:38 2023] GET /compute/v2.1/servers/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=10 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:38 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:58:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2" status: 204 len: 0 microversion: 2.87 time: 0.148284 Apr 14 01:58:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 257/763] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:58:38 2023] DELETE /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:38 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-15400ddb-b1dc-42cb-81b3-a8e867af61f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2" status: 200 len: 1696 microversion: 2.87 time: 0.230518 Apr 14 01:58:38 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 254/764] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:58:38 2023] GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2 => generated 1696 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:58:38 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae82789e-1bed-419b-a580-68ff7ed03ef2", "name": "network-vif-unplugged", "status": "completed", "tag": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] Creating event network-vif-unplugged:1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance ae82789e-1bed-419b-a580-68ff7ed03ef2 on user Apr 14 01:58:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060115 Apr 14 01:58:39 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 254/765] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:39 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae82789e-1bed-419b-a580-68ff7ed03ef2", "name": "network-vif-deleted", "tag": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:39 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] Creating event network-vif-deleted:1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance ae82789e-1bed-419b-a580-68ff7ed03ef2 on user Apr 14 01:58:39 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028360 Apr 14 01:58:39 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 258/766] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:41 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae82789e-1bed-419b-a580-68ff7ed03ef2", "name": "network-vif-plugged", "status": "completed", "tag": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] Creating event network-vif-plugged:1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance ae82789e-1bed-419b-a580-68ff7ed03ef2 on user Apr 14 01:58:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029619 Apr 14 01:58:41 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 255/767] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:56 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:58:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 204 len: 0 microversion: 2.1 time: 0.170108 Apr 14 01:58:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 255/768] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:58:56 2023] DELETE /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:56 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:58:56 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f57d2d55-bab0-41b9-9cbc-5244a841ddc3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 200 len: 1727 microversion: 2.1 time: 0.241231 Apr 14 01:58:56 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 259/769] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:58:56 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 1727 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:58:56 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=8 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:56 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=14 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:58:57 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-unplugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:57 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] Creating event network-vif-unplugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:58:57 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035270 Apr 14 01:58:57 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 256/770] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:58:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-plugged", "status": "completed", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}, {"server_uuid": "73cc8ede-babd-4281-bf1d-c5a3f8bad440", "name": "network-vif-deleted", "tag": "84d281bf-164e-48f3-a3ee-ca796d9a48e7"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:58:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:58:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:58:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:58:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] Creating event network-vif-plugged:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:58:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] Creating event network-vif-deleted:84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 on user Apr 14 01:58:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038347 Apr 14 01:58:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 256/771] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:58:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:00 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:00 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-28a5e036-99b5-410e-9cf1-f91027308b1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1656 microversion: 2.1 time: 0.158568 Apr 14 01:59:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 260/772] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:59:00 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1656 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:13 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:13 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ab2c6d3d-6a85-4e30-8f6e-8a8d675dc703 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 200 len: 1653 microversion: 2.20 time: 0.164778 Apr 14 01:59:13 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 257/773] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:59:13 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 1653 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-8045afe6-7dd9-49e5-993a-7d66a63036ae tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-8045afe6-7dd9-49e5-993a-7d66a63036ae tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8045afe6-7dd9-49e5-993a-7d66a63036ae tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8045afe6-7dd9-49e5-993a-7d66a63036ae tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8045afe6-7dd9-49e5-993a-7d66a63036ae tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8045afe6-7dd9-49e5-993a-7d66a63036ae tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8045afe6-7dd9-49e5-993a-7d66a63036ae tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8045afe6-7dd9-49e5-993a-7d66a63036ae tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-8045afe6-7dd9-49e5-993a-7d66a63036ae tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.190943 Apr 14 01:59:19 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 257/774] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 01:59:19 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-interface => generated 283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:21 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=12 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] Creating event network-changed:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:59:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032927 Apr 14 01:59:21 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 261/775] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:21 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:21 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:21 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'services' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 01:59:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments/4c279a98-9587-47a8-a153-408cc1232415" status: 202 len: 0 microversion: 2.1 time: 0.192439 Apr 14 01:59:21 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 258/776] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 01:59:21 2023] DELETE /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments/4c279a98-9587-47a8-a153-408cc1232415 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 01:59:21 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-6221974c-7fb5-4660-9122-51e737abfb71 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:21 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-6221974c-7fb5-4660-9122-51e737abfb71 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6221974c-7fb5-4660-9122-51e737abfb71 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6221974c-7fb5-4660-9122-51e737abfb71 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6221974c-7fb5-4660-9122-51e737abfb71 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6221974c-7fb5-4660-9122-51e737abfb71 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6221974c-7fb5-4660-9122-51e737abfb71 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:21 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6221974c-7fb5-4660-9122-51e737abfb71 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:21 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-6221974c-7fb5-4660-9122-51e737abfb71 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Apr 14 01:59:21 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 258/777] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:59:21 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:23 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:23 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] Creating event network-changed:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 01:59:23 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030279 Apr 14 01:59:23 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 262/778] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] HTTP exception thrown: Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 could not be found. Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Request method failure captured: Apr 14 01:59:29 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2 HTTP/1.1 Apr 14 01:59:29 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:59:29 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:59:29 user devstack@n-api.service[61837]: Connection: close Apr 14 01:59:29 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:59:29 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:59:29 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:59:29 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:59:29 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK8YTacedubWAhS5rzw9JEaPTG6xragTyjkfiQpMHhqdPKL_vIFx7Oo0JcBunIx_gKjHSnOM3lGZ4EkV-RuKODkLPPDokoxlpPECSblRT_d9310zSanCDjB-AierWxHKALLBIh7z2dQ-4JeglItcl5hi6xs8sG_wjDrJggOpq61Yt2c Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Project-Id: 219c39c8299e46368012a947fdfbe5fd Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/219c39c8299e46368012a947fdfbe5fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/219c39c8299e46368012a947fdfbe5fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/219c39c8299e46368012a947fdfbe5fd"}]}] Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Tenant-Id: 219c39c8299e46368012a947fdfbe5fd Apr 14 01:59:29 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 01:59:29 user devstack@n-api.service[61837]: X-User: tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member Apr 14 01:59:29 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:59:29 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:59:29 user devstack@n-api.service[61837]: X-User-Id: 7ed01a83531f4c6bb18a4593284baf05 Apr 14 01:59:29 user devstack@n-api.service[61837]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member Apr 14 01:59:29 user devstack@n-api.service[61837]: method: > Apr 14 01:59:29 user devstack@n-api.service[61837]: exception: Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 could not be found. Apr 14 01:59:29 user devstack@n-api.service[61837]: action_args: {'id': 'ae82789e-1bed-419b-a580-68ff7ed03ef2'} Apr 14 01:59:29 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 could not be found. Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 could not be found. Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 could not be found. Apr 14 01:59:29 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Returning 404 to user: Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:59:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-be204375-3696-42b4-bb68-d5a52f6b46ed tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2" status: 404 len: 111 microversion: 2.87 time: 0.036463 Apr 14 01:59:29 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 259/779] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:59:29 2023] GET /compute/v2.1/servers/ae82789e-1bed-419b-a580-68ff7ed03ef2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 01:59:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:29 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:29 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:59:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c" status: 204 len: 0 microversion: 2.87 time: 0.117250 Apr 14 01:59:29 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 259/780] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 01:59:29 2023] DELETE /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:29 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f5b94ae6-2ddc-4462-9b8f-29e25e69f648 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c" status: 200 len: 1775 microversion: 2.87 time: 0.206635 Apr 14 01:59:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 263/781] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 01:59:29 2023] GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c => generated 1775 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-unplugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] Creating event network-vif-unplugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:59:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031217 Apr 14 01:59:29 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 260/782] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:31 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-plugged", "status": "completed", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}, {"server_uuid": "73fd9bc1-af0f-41e9-adea-d73323b4a76c", "name": "network-vif-deleted", "tag": "4146457e-4b16-4c22-afd2-ffae8a58c0c5"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:31 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] Creating event network-vif-plugged:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:59:31 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] Creating event network-vif-deleted:4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c on user Apr 14 01:59:31 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029101 Apr 14 01:59:31 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 260/783] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:35 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:36 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-51b3fcf7-d81c-416b-91f6-7a32af658b7d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329" status: 200 len: 1440 microversion: 2.1 time: 0.147979 Apr 14 01:59:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 264/784] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:59:35 2023] GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329 => generated 1440 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81666244-a2a7-4ace-969d-a3a3d0128329", "tag": "d66c282d-74db-42ba-96f3-faf43ebc6d98"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] Creating event network-changed:d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance 81666244-a2a7-4ace-969d-a3a3d0128329 on user Apr 14 01:59:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028252 Apr 14 01:59:38 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 261/785] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:38 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81666244-a2a7-4ace-969d-a3a3d0128329", "tag": "d66c282d-74db-42ba-96f3-faf43ebc6d98"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:38 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] Creating event network-changed:d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance 81666244-a2a7-4ace-969d-a3a3d0128329 on user Apr 14 01:59:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035101 Apr 14 01:59:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 265/786] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:38 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 01:59:38 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329" status: 204 len: 0 microversion: 2.1 time: 0.133424 Apr 14 01:59:38 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 261/787] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 01:59:38 2023] DELETE /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:39 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:39 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-6c1a3f81-8eef-4a31-a9f9-8d0682c83804 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329" status: 200 len: 1565 microversion: 2.1 time: 0.206863 Apr 14 01:59:39 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 262/788] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:59:38 2023] GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329 => generated 1565 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:59:39 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81666244-a2a7-4ace-969d-a3a3d0128329", "name": "network-vif-unplugged", "status": "completed", "tag": "d66c282d-74db-42ba-96f3-faf43ebc6d98"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:39 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] Creating event network-vif-unplugged:d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance 81666244-a2a7-4ace-969d-a3a3d0128329 on user Apr 14 01:59:39 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033216 Apr 14 01:59:39 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 266/789] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:40 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81666244-a2a7-4ace-969d-a3a3d0128329", "name": "network-vif-deleted", "tag": "d66c282d-74db-42ba-96f3-faf43ebc6d98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:40 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] Creating event network-vif-deleted:d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance 81666244-a2a7-4ace-969d-a3a3d0128329 on user Apr 14 01:59:40 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030545 Apr 14 01:59:40 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 262/790] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:41 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81666244-a2a7-4ace-969d-a3a3d0128329", "name": "network-vif-plugged", "status": "completed", "tag": "d66c282d-74db-42ba-96f3-faf43ebc6d98"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] Creating event network-vif-plugged:d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance 81666244-a2a7-4ace-969d-a3a3d0128329 on user Apr 14 01:59:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027219 Apr 14 01:59:41 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 263/791] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HTTP exception thrown: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Request method failure captured: Apr 14 01:59:47 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 HTTP/1.1 Apr 14 01:59:47 user devstack@n-api.service[61836]: Accept: application/json Apr 14 01:59:47 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 01:59:47 user devstack@n-api.service[61836]: Connection: close Apr 14 01:59:47 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 01:59:47 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 01:59:47 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 01:59:47 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 01:59:47 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLAyAmjbZ4Ip4Yn_gzbn5tzy9loQSOvZJ19RfXr9RD273lL5zAY_k1-4eVimSbm9h6kyAWQI7EYGKXhfuMq7ANc67_B8gs-r2QFDmdkWH_TNu1qwT8WD-BfWZfCipAiP2SGrvJ368nutyt5JC02lxX6v70oTM6oHaHhBBksax4OchN8 Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Project-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Project-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}] Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Tenant: tempest-ServerActionsTestJSON-2035821517 Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Tenant-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 01:59:47 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 01:59:47 user devstack@n-api.service[61836]: X-User: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 01:59:47 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 01:59:47 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 01:59:47 user devstack@n-api.service[61836]: X-User-Id: 78ccd1a1ec1b486981d850881734fe02 Apr 14 01:59:47 user devstack@n-api.service[61836]: X-User-Name: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 01:59:47 user devstack@n-api.service[61836]: method: > Apr 14 01:59:47 user devstack@n-api.service[61836]: exception: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61836]: action_args: {'id': '73cc8ede-babd-4281-bf1d-c5a3f8bad440'} Apr 14 01:59:47 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Returning 404 to user: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:59:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f44ece5a-bb14-4106-995f-550b93a19386 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 404 len: 111 microversion: 2.1 time: 0.032820 Apr 14 01:59:47 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 267/792] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:59:47 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:47 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HTTP exception thrown: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Request method failure captured: Apr 14 01:59:47 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments HTTP/1.1 Apr 14 01:59:47 user devstack@n-api.service[61835]: Accept: application/json Apr 14 01:59:47 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 01:59:47 user devstack@n-api.service[61835]: Connection: close Apr 14 01:59:47 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 01:59:47 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 01:59:47 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 01:59:47 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 01:59:47 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLAyAmjbZ4Ip4Yn_gzbn5tzy9loQSOvZJ19RfXr9RD273lL5zAY_k1-4eVimSbm9h6kyAWQI7EYGKXhfuMq7ANc67_B8gs-r2QFDmdkWH_TNu1qwT8WD-BfWZfCipAiP2SGrvJ368nutyt5JC02lxX6v70oTM6oHaHhBBksax4OchN8 Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Project-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}] Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Tenant: tempest-ServerActionsTestJSON-2035821517 Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Tenant-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 01:59:47 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 01:59:47 user devstack@n-api.service[61835]: X-User: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 01:59:47 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 01:59:47 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 01:59:47 user devstack@n-api.service[61835]: X-User-Id: 78ccd1a1ec1b486981d850881734fe02 Apr 14 01:59:47 user devstack@n-api.service[61835]: X-User-Name: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 01:59:47 user devstack@n-api.service[61835]: method: > Apr 14 01:59:47 user devstack@n-api.service[61835]: exception: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61835]: action_args: {'server_id': '73cc8ede-babd-4281-bf1d-c5a3f8bad440'} Apr 14 01:59:47 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Returning 404 to user: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:59:47 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5bddb617-c91e-4394-ba3c-ada1a2b38c1b tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031140 Apr 14 01:59:47 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 263/793] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 01:59:47 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=15 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:47 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HTTP exception thrown: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Request method failure captured: Apr 14 01:59:47 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 HTTP/1.1 Apr 14 01:59:47 user devstack@n-api.service[61837]: Accept: application/json Apr 14 01:59:47 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 01:59:47 user devstack@n-api.service[61837]: Connection: close Apr 14 01:59:47 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 01:59:47 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 01:59:47 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 01:59:47 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 01:59:47 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLAyAmjbZ4Ip4Yn_gzbn5tzy9loQSOvZJ19RfXr9RD273lL5zAY_k1-4eVimSbm9h6kyAWQI7EYGKXhfuMq7ANc67_B8gs-r2QFDmdkWH_TNu1qwT8WD-BfWZfCipAiP2SGrvJ368nutyt5JC02lxX6v70oTM6oHaHhBBksax4OchN8 Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Project-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Project-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}] Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Tenant: tempest-ServerActionsTestJSON-2035821517 Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Tenant-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 01:59:47 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 01:59:47 user devstack@n-api.service[61837]: X-User: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 01:59:47 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 01:59:47 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 01:59:47 user devstack@n-api.service[61837]: X-User-Id: 78ccd1a1ec1b486981d850881734fe02 Apr 14 01:59:47 user devstack@n-api.service[61837]: X-User-Name: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 01:59:47 user devstack@n-api.service[61837]: method: > Apr 14 01:59:47 user devstack@n-api.service[61837]: exception: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61837]: action_args: {'id': '73cc8ede-babd-4281-bf1d-c5a3f8bad440'} Apr 14 01:59:47 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 01:59:47 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 01:59:47 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Returning 404 to user: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 01:59:47 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b495164d-4453-4109-8f45-5adeeb90f101 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 404 len: 111 microversion: 2.1 time: 0.034085 Apr 14 01:59:47 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 264/794] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:59:47 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1095400783", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775"}], "security_groups": [{"name": "tempest-securitygroup--1165615482"}], "key_name": "tempest-keypair-165395776", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] validate_networks() for [('c74d53a0-681c-4b19-b3a3-f51d6cfc7775', None, None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for user 78ccd1a1ec1b486981d850881734fe02 and project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 01:59:47 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 01:59:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.560293 Apr 14 01:59:47 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 268/795] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 01:59:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f1435a11-0994-4590-9df3-1720e6c14afb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-f1435a11-0994-4590-9df3-1720e6c14afb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 01:59:47 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-f1435a11-0994-4590-9df3-1720e6c14afb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 01:59:47 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f1435a11-0994-4590-9df3-1720e6c14afb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06" status: 200 len: 1232 microversion: 2.1 time: 0.064811 Apr 14 01:59:47 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 264/796] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 01:59:47 2023] GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06 => generated 1232 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 01:59:50 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba29111-1e9b-4947-b046-6bbe888eca06", "tag": "5b8a0a31-9ecf-4b31-a458-778005d846f4"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] Creating event network-changed:5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance 5ba29111-1e9b-4947-b046-6bbe888eca06 on user Apr 14 01:59:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028550 Apr 14 01:59:50 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 265/797] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:52 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba29111-1e9b-4947-b046-6bbe888eca06", "name": "network-vif-plugged", "status": "completed", "tag": "5b8a0a31-9ecf-4b31-a458-778005d846f4"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:52 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:52 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:52 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=25 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:52 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] Creating event network-vif-plugged:5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance 5ba29111-1e9b-4947-b046-6bbe888eca06 on user Apr 14 01:59:52 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038862 Apr 14 01:59:52 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 269/798] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 01:59:54 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba29111-1e9b-4947-b046-6bbe888eca06", "name": "network-vif-plugged", "status": "completed", "tag": "5b8a0a31-9ecf-4b31-a458-778005d846f4"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 01:59:54 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:54 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 01:59:54 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 01:59:54 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 01:59:54 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:59:54 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] Creating event network-vif-plugged:5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance 5ba29111-1e9b-4947-b046-6bbe888eca06 on user Apr 14 01:59:54 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035235 Apr 14 01:59:54 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 265/799] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 01:59:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-51f4dfe6-80a1-4cec-be58-67a029c0db5f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-51f4dfe6-80a1-4cec-be58-67a029c0db5f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-51f4dfe6-80a1-4cec-be58-67a029c0db5f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-51f4dfe6-80a1-4cec-be58-67a029c0db5f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-51f4dfe6-80a1-4cec-be58-67a029c0db5f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-51f4dfe6-80a1-4cec-be58-67a029c0db5f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-51f4dfe6-80a1-4cec-be58-67a029c0db5f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-51f4dfe6-80a1-4cec-be58-67a029c0db5f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:01 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-51f4dfe6-80a1-4cec-be58-67a029c0db5f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052782 Apr 14 02:00:01 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 266/800] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:00:01 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:01 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:00:01 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 204 len: 0 microversion: 2.1 time: 0.118394 Apr 14 02:00:01 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 270/801] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:00:01 2023] DELETE /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:01 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:01 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ddf534d7-fcac-4453-815e-fc2ee105910e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 200 len: 1662 microversion: 2.1 time: 0.199286 Apr 14 02:00:01 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 266/802] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:00:01 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 1662 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-unplugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:01 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:01 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] Creating event network-vif-unplugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 02:00:01 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.334995 Apr 14 02:00:01 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 267/803] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:04 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-plugged", "status": "completed", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}, {"server_uuid": "85b399dc-62df-480d-8561-5d9d1ab75c52", "name": "network-vif-deleted", "tag": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:04 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:04 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:04 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:04 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] Creating event network-vif-plugged:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 02:00:04 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] Creating event network-vif-deleted:e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 on user Apr 14 02:00:04 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029308 Apr 14 02:00:04 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 271/804] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-7bf6df0e-aebc-49ed-8ba7-1ea50790f84a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:11 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-7bf6df0e-aebc-49ed-8ba7-1ea50790f84a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:11 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=7 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7bf6df0e-aebc-49ed-8ba7-1ea50790f84a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7bf6df0e-aebc-49ed-8ba7-1ea50790f84a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7bf6df0e-aebc-49ed-8ba7-1ea50790f84a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7bf6df0e-aebc-49ed-8ba7-1ea50790f84a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7bf6df0e-aebc-49ed-8ba7-1ea50790f84a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7bf6df0e-aebc-49ed-8ba7-1ea50790f84a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-7bf6df0e-aebc-49ed-8ba7-1ea50790f84a tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049730 Apr 14 02:00:12 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 267/805] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:00:11 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=8 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:12 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:00:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" status: 204 len: 0 microversion: 2.1 time: 0.123766 Apr 14 02:00:12 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 268/806] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:00:12 2023] DELETE /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:00:12 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:12 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:12 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:12 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:12 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-49bd2370-ee73-49fb-a0fb-f071b981d0d6 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" status: 200 len: 1677 microversion: 2.1 time: 0.166190 Apr 14 02:00:12 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 272/807] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:00:12 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-unplugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] Creating event network-vif-unplugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 02:00:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040006 Apr 14 02:00:12 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 268/808] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:13 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-7b418b51-6790-4284-a2f3-913b59fb5f85 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58e2cd82-9771-4c59-8fe0-b03034cbe005"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:13 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-7b418b51-6790-4284-a2f3-913b59fb5f85 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7b418b51-6790-4284-a2f3-913b59fb5f85 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7b418b51-6790-4284-a2f3-913b59fb5f85 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7b418b51-6790-4284-a2f3-913b59fb5f85 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7b418b51-6790-4284-a2f3-913b59fb5f85 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7b418b51-6790-4284-a2f3-913b59fb5f85 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7b418b51-6790-4284-a2f3-913b59fb5f85 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-7b418b51-6790-4284-a2f3-913b59fb5f85 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.360419 Apr 14 02:00:14 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 269/809] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 02:00:13 2023] POST /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/os-volume_attachments => generated 188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-50979cb5-3576-47ed-9b89-94bb11863ec0 req-44e6af88-0c21-4ecc-a7af-a436779bafb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-deleted", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-50979cb5-3576-47ed-9b89-94bb11863ec0 req-44e6af88-0c21-4ecc-a7af-a436779bafb1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-50979cb5-3576-47ed-9b89-94bb11863ec0 req-44e6af88-0c21-4ecc-a7af-a436779bafb1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-50979cb5-3576-47ed-9b89-94bb11863ec0 req-44e6af88-0c21-4ecc-a7af-a436779bafb1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-50979cb5-3576-47ed-9b89-94bb11863ec0 req-44e6af88-0c21-4ecc-a7af-a436779bafb1 service nova] Creating event network-vif-deleted:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 02:00:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-50979cb5-3576-47ed-9b89-94bb11863ec0 req-44e6af88-0c21-4ecc-a7af-a436779bafb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029271 Apr 14 02:00:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 273/810] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:14 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-544ca86f-1227-421b-84a0-b9eeebe2a99c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:14 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-544ca86f-1227-421b-84a0-b9eeebe2a99c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-544ca86f-1227-421b-84a0-b9eeebe2a99c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-544ca86f-1227-421b-84a0-b9eeebe2a99c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-544ca86f-1227-421b-84a0-b9eeebe2a99c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-544ca86f-1227-421b-84a0-b9eeebe2a99c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-544ca86f-1227-421b-84a0-b9eeebe2a99c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-544ca86f-1227-421b-84a0-b9eeebe2a99c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] Creating event network-vif-plugged:69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 on user Apr 14 02:00:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038618 Apr 14 02:00:14 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 270/811] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-544ca86f-1227-421b-84a0-b9eeebe2a99c tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/os-volume_attachments/58e2cd82-9771-4c59-8fe0-b03034cbe005" status: 202 len: 0 microversion: 2.20 time: 0.272359 Apr 14 02:00:14 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 269/812] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 02:00:14 2023] DELETE /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/os-volume_attachments/58e2cd82-9771-4c59-8fe0-b03034cbe005 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:14 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61836) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 02:00:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/action" status: 202 len: 0 microversion: 2.20 time: 0.138707 Apr 14 02:00:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 274/813] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 02:00:14 2023] POST /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:15 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b349ba4f-663f-4486-b846-5cd0d7ad0bed tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 200 len: 1661 microversion: 2.20 time: 0.159538 Apr 14 02:00:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 271/814] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 02:00:14 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 1661 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 02:00:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] Creating event network-changed:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 02:00:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034084 Apr 14 02:00:17 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 270/815] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:19 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] HTTP exception thrown: Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c could not be found. Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Request method failure captured: Apr 14 02:00:19 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c HTTP/1.1 Apr 14 02:00:19 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:00:19 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:00:19 user devstack@n-api.service[61836]: Connection: close Apr 14 02:00:19 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:00:19 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:00:19 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:00:19 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:00:19 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8YTacedubWAhS5rzw9JEaPTG6xragTyjkfiQpMHhqdPKL_vIFx7Oo0JcBunIx_gKjHSnOM3lGZ4EkV-RuKODkLPPDokoxlpPECSblRT_d9310zSanCDjB-AierWxHKALLBIh7z2dQ-4JeglItcl5hi6xs8sG_wjDrJggOpq61Yt2c Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Project-Id: 219c39c8299e46368012a947fdfbe5fd Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/219c39c8299e46368012a947fdfbe5fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/219c39c8299e46368012a947fdfbe5fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/219c39c8299e46368012a947fdfbe5fd"}]}] Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Tenant-Id: 219c39c8299e46368012a947fdfbe5fd Apr 14 02:00:19 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 02:00:19 user devstack@n-api.service[61836]: X-User: tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member Apr 14 02:00:19 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:00:19 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:00:19 user devstack@n-api.service[61836]: X-User-Id: 7ed01a83531f4c6bb18a4593284baf05 Apr 14 02:00:19 user devstack@n-api.service[61836]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member Apr 14 02:00:19 user devstack@n-api.service[61836]: method: > Apr 14 02:00:19 user devstack@n-api.service[61836]: exception: Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c could not be found. Apr 14 02:00:19 user devstack@n-api.service[61836]: action_args: {'id': '73fd9bc1-af0f-41e9-adea-d73323b4a76c'} Apr 14 02:00:19 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c could not be found. Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c could not be found. Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c could not be found. Apr 14 02:00:19 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:00:19 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Returning 404 to user: Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:00:19 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-49c0df84-d7fc-44d1-891d-98b1e2c2b471 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c" status: 404 len: 111 microversion: 2.87 time: 0.032217 Apr 14 02:00:19 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 275/816] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 02:00:19 2023] GET /compute/v2.1/servers/73fd9bc1-af0f-41e9-adea-d73323b4a76c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:00:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:00:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85" status: 204 len: 0 microversion: 2.87 time: 0.113140 Apr 14 02:00:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 272/817] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 02:00:19 2023] DELETE /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 02:00:19 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:19 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:20 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:20 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:20 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-1e6c3919-79ec-472a-9926-11d6925c32f9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85" status: 200 len: 1697 microversion: 2.87 time: 0.253416 Apr 14 02:00:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 271/818] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 02:00:19 2023] GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85 => generated 1697 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 02:00:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e042a42-7cc2-4d72-b7ed-2b80339f2c85", "name": "network-vif-unplugged", "status": "completed", "tag": "ed749832-992f-44d3-8316-87f59088b737"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] Creating event network-vif-unplugged:ed749832-992f-44d3-8316-87f59088b737 for instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 on user Apr 14 02:00:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028305 Apr 14 02:00:20 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 276/819] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:21 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-150c32c9-272a-4ac6-9793-cf1e5f016156 req-fb366236-bb4d-4704-b157-e104b8391a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e042a42-7cc2-4d72-b7ed-2b80339f2c85", "name": "network-vif-deleted", "tag": "ed749832-992f-44d3-8316-87f59088b737"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-150c32c9-272a-4ac6-9793-cf1e5f016156 req-fb366236-bb4d-4704-b157-e104b8391a50 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-150c32c9-272a-4ac6-9793-cf1e5f016156 req-fb366236-bb4d-4704-b157-e104b8391a50 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-150c32c9-272a-4ac6-9793-cf1e5f016156 req-fb366236-bb4d-4704-b157-e104b8391a50 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-150c32c9-272a-4ac6-9793-cf1e5f016156 req-fb366236-bb4d-4704-b157-e104b8391a50 service nova] Creating event network-vif-deleted:ed749832-992f-44d3-8316-87f59088b737 for instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 on user Apr 14 02:00:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-150c32c9-272a-4ac6-9793-cf1e5f016156 req-fb366236-bb4d-4704-b157-e104b8391a50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030402 Apr 14 02:00:21 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 273/820] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:22 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e042a42-7cc2-4d72-b7ed-2b80339f2c85", "name": "network-vif-plugged", "status": "completed", "tag": "ed749832-992f-44d3-8316-87f59088b737"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:22 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] Creating event network-vif-plugged:ed749832-992f-44d3-8316-87f59088b737 for instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 on user Apr 14 02:00:22 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090125 Apr 14 02:00:22 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 272/821] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "name": "network-vif-plugged", "status": "completed", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:24 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:24 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] Creating event network-vif-plugged:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 02:00:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041674 Apr 14 02:00:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 277/822] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:26 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "name": "network-vif-plugged", "status": "completed", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:26 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:26 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] Creating event network-vif-plugged:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 02:00:26 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032393 Apr 14 02:00:26 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 274/823] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 81666244-a2a7-4ace-969d-a3a3d0128329 could not be found. Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 02:00:29 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329 HTTP/1.1 Apr 14 02:00:29 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:00:29 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:00:29 user devstack@n-api.service[61835]: Connection: close Apr 14 02:00:29 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:00:29 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:00:29 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:00:29 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:00:29 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 02:00:29 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 02:00:29 user devstack@n-api.service[61835]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 02:00:29 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:00:29 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:00:29 user devstack@n-api.service[61835]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 02:00:29 user devstack@n-api.service[61835]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 02:00:29 user devstack@n-api.service[61835]: method: > Apr 14 02:00:29 user devstack@n-api.service[61835]: exception: Instance 81666244-a2a7-4ace-969d-a3a3d0128329 could not be found. Apr 14 02:00:29 user devstack@n-api.service[61835]: action_args: {'id': '81666244-a2a7-4ace-969d-a3a3d0128329'} Apr 14 02:00:29 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81666244-a2a7-4ace-969d-a3a3d0128329 could not be found. Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81666244-a2a7-4ace-969d-a3a3d0128329 could not be found. Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81666244-a2a7-4ace-969d-a3a3d0128329 could not be found. Apr 14 02:00:29 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:00:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 81666244-a2a7-4ace-969d-a3a3d0128329 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:00:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-56dde53b-8f7d-4db5-97c2-b78941441254 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329" status: 404 len: 111 microversion: 2.1 time: 0.110943 Apr 14 02:00:29 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 273/824] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:00:29 2023] GET /compute/v2.1/servers/81666244-a2a7-4ace-969d-a3a3d0128329 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618f5f0d-3594-41dd-9d8f-0c7bea255a3f", "tag": "7eb65ace-3427-4415-a8ef-26064243471e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:36 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:00:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] Creating event network-changed:7eb65ace-3427-4415-a8ef-26064243471e for instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f on user Apr 14 02:00:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046299 Apr 14 02:00:36 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 275/825] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f" status: 204 len: 0 microversion: 2.1 time: 0.117854 Apr 14 02:00:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 278/826] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:00:36 2023] DELETE /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:00:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:36 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:36 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-c6a7257c-d0a6-4fc3-b9ba-ac68cc908218 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f" status: 200 len: 1566 microversion: 2.1 time: 0.187414 Apr 14 02:00:36 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 274/827] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:00:36 2023] GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618f5f0d-3594-41dd-9d8f-0c7bea255a3f", "name": "network-vif-unplugged", "status": "completed", "tag": "7eb65ace-3427-4415-a8ef-26064243471e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] Creating event network-vif-unplugged:7eb65ace-3427-4415-a8ef-26064243471e for instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f on user Apr 14 02:00:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028674 Apr 14 02:00:36 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 276/828] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:38 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:38 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f26973ca-6d52-413f-8bb1-fbfe6e426b52 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06" status: 200 len: 1539 microversion: 2.1 time: 0.343794 Apr 14 02:00:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 279/829] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:00:38 2023] GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06 => generated 1539 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:00:39 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618f5f0d-3594-41dd-9d8f-0c7bea255a3f", "name": "network-vif-plugged", "status": "completed", "tag": "7eb65ace-3427-4415-a8ef-26064243471e"}, {"server_uuid": "618f5f0d-3594-41dd-9d8f-0c7bea255a3f", "name": "network-vif-deleted", "tag": "7eb65ace-3427-4415-a8ef-26064243471e"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:39 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] Creating event network-vif-plugged:7eb65ace-3427-4415-a8ef-26064243471e for instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f on user Apr 14 02:00:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] Creating event network-vif-deleted:7eb65ace-3427-4415-a8ef-26064243471e for instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f on user Apr 14 02:00:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038026 Apr 14 02:00:39 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 275/830] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HTTP exception thrown: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Request method failure captured: Apr 14 02:00:51 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 HTTP/1.1 Apr 14 02:00:51 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:00:51 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:00:51 user devstack@n-api.service[61837]: Connection: close Apr 14 02:00:51 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:00:51 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:00:51 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:00:51 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:00:51 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLFldGo9jZhTmb_tN--IRSA9XgJtaMoTswawgwTx52Sao35ycMIOPAi4xnlNHb2wveuwGUTl8mo6SU_tBLN_Qz4XqZCaHCChiFRiaNMUjSsXQGI_pglqWVcDbLJ8q1LWcpaiRlz-NrpuyMb47K8Lt8fGMjPYSK-ZYV9FyIY_IUNkMMw Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Project-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}] Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Tenant-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:00:51 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:00:51 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:00:51 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:00:51 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:00:51 user devstack@n-api.service[61837]: X-User-Id: ba0894753a074f99ab226fde0565dd28 Apr 14 02:00:51 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:00:51 user devstack@n-api.service[61837]: method: > Apr 14 02:00:51 user devstack@n-api.service[61837]: exception: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:00:51 user devstack@n-api.service[61837]: action_args: {'id': '85b399dc-62df-480d-8561-5d9d1ab75c52'} Apr 14 02:00:51 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:00:51 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:00:51 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Returning 404 to user: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:00:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3b58a488-2bc5-417d-95b3-d766ad510697 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 404 len: 111 microversion: 2.1 time: 0.039797 Apr 14 02:00:51 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 277/831] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:00:51 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:00:51 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c0ffa196-190f-4606-8328-7b75b21dc8b7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '.version_select at 0x7fd420c8bbe0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:51 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:51 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c0ffa196-190f-4606-8328-7b75b21dc8b7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007571811" status: 202 len: 0 microversion: 2.1 time: 0.025316 Apr 14 02:00:51 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 280/832] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 02:00:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007571811 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 02:00:52 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=20 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:52 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:00:52 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3867e653-0447-46d4-9a8d-88f4420625e3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'create', calling method: .version_select at 0x7fd42057f490>, body: {"keypair": {"name": "tempest-keypair-1642286085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgxLG6u+CLZO6ez2euu9C5tc+/T2XOCpUbIazierEJc6wvMtj8tQF3K8twfznW6n+gHEfT2+fHG3IrWuhzSDZudXAmAV0UsgnPo1pT6EO7QTUJ4jJt7CdfqhPDSKhung=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:52 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-3867e653-0447-46d4-9a8d-88f4420625e3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting quotas for project 0f650e04d2c947498b9e7a8d002862ad. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:00:52 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-3867e653-0447-46d4-9a8d-88f4420625e3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting quotas for user ba0894753a074f99ab226fde0565dd28 and project 0f650e04d2c947498b9e7a8d002862ad. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:00:52 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-3867e653-0447-46d4-9a8d-88f4420625e3 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057423 Apr 14 02:00:52 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 276/833] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:00:52 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-894252915", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a"}], "security_groups": [{"name": "tempest-securitygroup--2123010458"}], "key_name": "tempest-keypair-1642286085", "user_data": "}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] validate_networks() for [('fe9d57b9-96e8-424e-8dc9-0c95f1aff03a', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting quotas for project 0f650e04d2c947498b9e7a8d002862ad. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting quotas for user ba0894753a074f99ab226fde0565dd28 and project 0f650e04d2c947498b9e7a8d002862ad. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:00:54 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:00:54 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.694232 Apr 14 02:00:54 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 278/834] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:00:54 2023] POST /compute/v2.1/servers => generated 400 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:00:54 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d2da3f03-c2f3-40bd-90c0-2955a9e7e149 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:00:54 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d2da3f03-c2f3-40bd-90c0-2955a9e7e149 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:00:55 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d2da3f03-c2f3-40bd-90c0-2955a9e7e149 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:00:55 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d2da3f03-c2f3-40bd-90c0-2955a9e7e149 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe" status: 200 len: 1231 microversion: 2.1 time: 0.067390 Apr 14 02:00:55 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 281/835] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:00:54 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe => generated 1231 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:00:57 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c5d54a-48a6-4600-b87b-e1318e35c1fe", "tag": "617da89e-c0c3-455c-992f-893a43fa7d3e"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:57 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] Creating event network-changed:617da89e-c0c3-455c-992f-893a43fa7d3e for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe on user Apr 14 02:00:57 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029119 Apr 14 02:00:57 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 277/836] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:00:59 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c5d54a-48a6-4600-b87b-e1318e35c1fe", "name": "network-vif-plugged", "status": "completed", "tag": "617da89e-c0c3-455c-992f-893a43fa7d3e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:00:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:00:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:00:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:00:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] Creating event network-vif-plugged:617da89e-c0c3-455c-992f-893a43fa7d3e for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe on user Apr 14 02:00:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057704 Apr 14 02:00:59 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 279/837] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:00:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:01:01 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c5d54a-48a6-4600-b87b-e1318e35c1fe", "name": "network-vif-plugged", "status": "completed", "tag": "617da89e-c0c3-455c-992f-893a43fa7d3e"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:01:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:01 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:01 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] Creating event network-vif-plugged:617da89e-c0c3-455c-992f-893a43fa7d3e for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe on user Apr 14 02:01:01 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028149 Apr 14 02:01:01 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 282/838] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:01:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] HTTP exception thrown: Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 could not be found. Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Request method failure captured: Apr 14 02:01:02 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 HTTP/1.1 Apr 14 02:01:02 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:01:02 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:01:02 user devstack@n-api.service[61835]: Connection: close Apr 14 02:01:02 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:01:02 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:01:02 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:01:02 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:01:02 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLAimNIpGvJxJ2K7x8_hYJlXVV3qbjMTDXN3Xm447JCUfxZDn-Wf0sl4YUvlfGEuUHZqEnw9ZwrHlGRKKi38xTuTU3GwUFRksR_fDEaBtrl_61Nk7ZcffAI89Uw3GQZ3tj6UHny8Z7R-nkYcye6xq1TYYcwo_Vs_FB25z0QmbgeF8b0 Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Project-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}] Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Tenant-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 02:01:02 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 02:01:02 user devstack@n-api.service[61835]: X-User: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 02:01:02 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:01:02 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:01:02 user devstack@n-api.service[61835]: X-User-Id: eeb5f26be86e43b3b61fff98fdc83cf3 Apr 14 02:01:02 user devstack@n-api.service[61835]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 02:01:02 user devstack@n-api.service[61835]: method: > Apr 14 02:01:02 user devstack@n-api.service[61835]: exception: Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 could not be found. Apr 14 02:01:02 user devstack@n-api.service[61835]: action_args: {'id': '92e640b7-a222-4b2f-8d9f-7151cfc7dcc7'} Apr 14 02:01:02 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 could not be found. Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 could not be found. Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 could not be found. Apr 14 02:01:02 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Returning 404 to user: Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:01:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-caaf41f9-c754-4baf-8fc5-c419914db4e8 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" status: 404 len: 111 microversion: 2.1 time: 0.032196 Apr 14 02:01:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 278/839] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:01:02 2023] GET /compute/v2.1/servers/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:01:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-19e3c522-97e2-43c2-8b28-573a4db3912c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '.version_select at 0x7fd420e3edd0>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-19e3c522-97e2-43c2-8b28-573a4db3912c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843861517" status: 202 len: 0 microversion: 2.1 time: 0.030163 Apr 14 02:01:02 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 280/840] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 02:01:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843861517 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:01:05 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:01:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-db6057cc-c186-42ae-80d2-5361b68b4654 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 200 len: 1706 microversion: 2.20 time: 0.180809 Apr 14 02:01:05 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 283/841] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 02:01:05 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 1706 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 02:01:09 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:09 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:09 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:01:09 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa" status: 204 len: 0 microversion: 2.1 time: 0.127171 Apr 14 02:01:09 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 279/842] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:01:09 2023] DELETE /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:10 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:01:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-41b24643-8cde-436b-9c44-13aa13a8e080 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa" status: 200 len: 1496 microversion: 2.1 time: 0.212517 Apr 14 02:01:10 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 281/843] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:01:09 2023] GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa => generated 1496 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:01:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] HTTP exception thrown: Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 could not be found. Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Request method failure captured: Apr 14 02:01:10 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85 HTTP/1.1 Apr 14 02:01:10 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:01:10 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:01:10 user devstack@n-api.service[61836]: Connection: close Apr 14 02:01:10 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:01:10 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:01:10 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:01:10 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:01:10 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK8YTacedubWAhS5rzw9JEaPTG6xragTyjkfiQpMHhqdPKL_vIFx7Oo0JcBunIx_gKjHSnOM3lGZ4EkV-RuKODkLPPDokoxlpPECSblRT_d9310zSanCDjB-AierWxHKALLBIh7z2dQ-4JeglItcl5hi6xs8sG_wjDrJggOpq61Yt2c Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Project-Id: 219c39c8299e46368012a947fdfbe5fd Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/219c39c8299e46368012a947fdfbe5fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/219c39c8299e46368012a947fdfbe5fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/219c39c8299e46368012a947fdfbe5fd"}]}] Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Tenant-Id: 219c39c8299e46368012a947fdfbe5fd Apr 14 02:01:10 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606 Apr 14 02:01:10 user devstack@n-api.service[61836]: X-User: tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member Apr 14 02:01:10 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:01:10 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:01:10 user devstack@n-api.service[61836]: X-User-Id: 7ed01a83531f4c6bb18a4593284baf05 Apr 14 02:01:10 user devstack@n-api.service[61836]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member Apr 14 02:01:10 user devstack@n-api.service[61836]: method: > Apr 14 02:01:10 user devstack@n-api.service[61836]: exception: Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 could not be found. Apr 14 02:01:10 user devstack@n-api.service[61836]: action_args: {'id': '8e042a42-7cc2-4d72-b7ed-2b80339f2c85'} Apr 14 02:01:10 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 could not be found. Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 could not be found. Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 could not be found. Apr 14 02:01:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Returning 404 to user: Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:01:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-49e51acc-94f8-496d-ae1d-1aa15ec304c0 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85" status: 404 len: 111 microversion: 2.87 time: 0.048299 Apr 14 02:01:10 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 284/844] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 02:01:10 2023] GET /compute/v2.1/servers/8e042a42-7cc2-4d72-b7ed-2b80339f2c85 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:01:10 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "name": "network-vif-unplugged", "status": "completed", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:01:10 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:10 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:10 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] Creating event network-vif-unplugged:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 02:01:10 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083968 Apr 14 02:01:10 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 280/845] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:01:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:01:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "name": "network-vif-plugged", "status": "completed", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}, {"server_uuid": "fa29c144-0ff9-4efb-a574-f521d18f08fa", "name": "network-vif-deleted", "tag": "6a841349-4e6e-40e1-90f0-998d46c60567"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:01:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] Creating event network-vif-plugged:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 02:01:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] Creating event network-vif-deleted:6a841349-4e6e-40e1-90f0-998d46c60567 for instance fa29c144-0ff9-4efb-a574-f521d18f08fa on user Apr 14 02:01:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032616 Apr 14 02:01:12 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 282/846] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:01:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=10 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f could not be found. Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 02:01:26 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f HTTP/1.1 Apr 14 02:01:26 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:01:26 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:01:26 user devstack@n-api.service[61836]: Connection: close Apr 14 02:01:26 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:01:26 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:01:26 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:01:26 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:01:26 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 02:01:26 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 02:01:26 user devstack@n-api.service[61836]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 02:01:26 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:01:26 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:01:26 user devstack@n-api.service[61836]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 02:01:26 user devstack@n-api.service[61836]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 02:01:26 user devstack@n-api.service[61836]: method: > Apr 14 02:01:26 user devstack@n-api.service[61836]: exception: Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f could not be found. Apr 14 02:01:26 user devstack@n-api.service[61836]: action_args: {'id': '618f5f0d-3594-41dd-9d8f-0c7bea255a3f'} Apr 14 02:01:26 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f could not be found. Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f could not be found. Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f could not be found. Apr 14 02:01:26 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:01:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:01:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-93ecb804-9456-41b3-8171-c3e450760fa3 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f" status: 404 len: 111 microversion: 2.1 time: 0.043402 Apr 14 02:01:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 285/847] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:01:26 2023] GET /compute/v2.1/servers/618f5f0d-3594-41dd-9d8f-0c7bea255a3f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 02:01:27 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f HTTP/1.1 Apr 14 02:01:27 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:01:27 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:01:27 user devstack@n-api.service[61835]: Connection: close Apr 14 02:01:27 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:01:27 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:01:27 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:01:27 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:01:27 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 02:01:27 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 02:01:27 user devstack@n-api.service[61835]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 02:01:27 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:01:27 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:01:27 user devstack@n-api.service[61835]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 02:01:27 user devstack@n-api.service[61835]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 02:01:27 user devstack@n-api.service[61835]: method: > Apr 14 02:01:27 user devstack@n-api.service[61835]: exception: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61835]: action_args: {'id': '410c2004-b2c8-4274-b1d3-9b48585c644f'} Apr 14 02:01:27 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:01:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-efdb0473-61fc-4d11-899c-142e9f8f1217 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f" status: 404 len: 111 microversion: 2.1 time: 0.037626 Apr 14 02:01:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 281/848] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:01:27 2023] DELETE /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=8 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HTTP exception thrown: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Request method failure captured: Apr 14 02:01:27 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f HTTP/1.1 Apr 14 02:01:27 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:01:27 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:01:27 user devstack@n-api.service[61837]: Connection: close Apr 14 02:01:27 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:01:27 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:01:27 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:01:27 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:01:27 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOK_zhU_sh5x9j8cQLUsqwy03tEd0iAFMsctkF0v-sjjbeLJ1l7uGkvavcrXRrJxG9gZ73ZtuleGqFqAEtJwNlRh6Uct9C64xMzPwckUZyVBCTI4Znql3xEGiNe-v1FCa3gmQed2bAh8R0PtTY5bmptAH30LPYsNq30z7T3llAY1BrIc Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Project-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1f4117a4adb4aa3b42951cf1fc84237"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1f4117a4adb4aa3b42951cf1fc84237"}]}] Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Tenant: tempest-TestVolumeBootPattern-224521177 Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Tenant-Id: c1f4117a4adb4aa3b42951cf1fc84237 Apr 14 02:01:27 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestVolumeBootPattern-224521177 Apr 14 02:01:27 user devstack@n-api.service[61837]: X-User: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 02:01:27 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:01:27 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:01:27 user devstack@n-api.service[61837]: X-User-Id: 50e3354ac1a84c59a7dee8e1ae6e771a Apr 14 02:01:27 user devstack@n-api.service[61837]: X-User-Name: tempest-TestVolumeBootPattern-224521177-project-member Apr 14 02:01:27 user devstack@n-api.service[61837]: method: > Apr 14 02:01:27 user devstack@n-api.service[61837]: exception: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61837]: action_args: {'id': '410c2004-b2c8-4274-b1d3-9b48585c644f'} Apr 14 02:01:27 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. Apr 14 02:01:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:01:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Returning 404 to user: Instance 410c2004-b2c8-4274-b1d3-9b48585c644f could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:01:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-a1756ed9-9b14-45c1-8dba-dcd0d4ab50d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f" status: 404 len: 111 microversion: 2.1 time: 0.036749 Apr 14 02:01:27 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 283/849] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:01:27 2023] GET /compute/v2.1/servers/410c2004-b2c8-4274-b1d3-9b48585c644f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:01:29 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-61dc9eec-6429-412b-b583-a5d1afc9e3d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Calling method '.version_select at 0x7fd420c8acb0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-61dc9eec-6429-412b-b583-a5d1afc9e3d8 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-824995165" status: 202 len: 0 microversion: 2.1 time: 0.024435 Apr 14 02:01:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 286/850] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 14 02:01:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-824995165 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-631914b1-8dea-4773-a688-2348fd98748c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-631914b1-8dea-4773-a688-2348fd98748c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-631914b1-8dea-4773-a688-2348fd98748c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-631914b1-8dea-4773-a688-2348fd98748c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-631914b1-8dea-4773-a688-2348fd98748c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-631914b1-8dea-4773-a688-2348fd98748c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-631914b1-8dea-4773-a688-2348fd98748c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-631914b1-8dea-4773-a688-2348fd98748c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:39 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-631914b1-8dea-4773-a688-2348fd98748c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.573621 Apr 14 02:01:39 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 282/851] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 02:01:38 2023] GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06/os-interface => generated 282 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:01:39 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:39 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:40 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba29111-1e9b-4947-b046-6bbe888eca06", "tag": "5b8a0a31-9ecf-4b31-a458-778005d846f4"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:01:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] Creating event network-changed:5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance 5ba29111-1e9b-4947-b046-6bbe888eca06 on user Apr 14 02:01:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214245 Apr 14 02:01:40 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 284/852] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:01:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:01:43 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:43 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:43 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-240203784", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775"}], "security_groups": [{"name": "tempest-securitygroup--1165615482"}], "key_name": "tempest-keypair-165395776", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "06b73a5e-5178-4561-af91-11e1028d2238", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:01:43 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] validate_networks() for [('c74d53a0-681c-4b19-b3a3-f51d6cfc7775', None, None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for user 78ccd1a1ec1b486981d850881734fe02 and project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:01:44 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06b73a5e-5178-4561-af91-11e1028d2238',volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:01:44 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.849511 Apr 14 02:01:44 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 287/853] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:01:43 2023] POST /compute/v2.1/servers => generated 404 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:01:44 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-6360663d-564b-443b-829a-32da62cdab74 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:44 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-6360663d-564b-443b-829a-32da62cdab74 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:44 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-6360663d-564b-443b-829a-32da62cdab74 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:01:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-6360663d-564b-443b-829a-32da62cdab74 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 200 len: 1074 microversion: 2.1 time: 0.069037 Apr 14 02:01:44 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 283/854] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:01:44 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 1074 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:01:45 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:01:45 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:01:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:45 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:45 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:01:45 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-defaed33-0265-4c66-a451-0b3eb1e3ecec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe" status: 200 len: 1537 microversion: 2.1 time: 0.404836 Apr 14 02:01:45 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 285/855] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:01:45 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe => generated 1537 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:01:46 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:01:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] Creating event network-changed:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:01:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028889 Apr 14 02:01:47 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 288/856] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:01:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:01:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "name": "network-vif-plugged", "status": "completed", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:01:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:56 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:56 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] Creating event network-vif-plugged:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:01:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043055 Apr 14 02:01:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 284/857] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:01:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:01:58 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "name": "network-vif-plugged", "status": "completed", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:01:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:58 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=8 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:01:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:01:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:01:58 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:01:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] Creating event network-vif-plugged:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:01:58 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038661 Apr 14 02:01:58 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 286/858] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:01:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] HTTP exception thrown: Instance fa29c144-0ff9-4efb-a574-f521d18f08fa could not be found. Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Request method failure captured: Apr 14 02:02:00 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa HTTP/1.1 Apr 14 02:02:00 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:02:00 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:02:00 user devstack@n-api.service[61836]: Connection: close Apr 14 02:02:00 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:02:00 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:02:00 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:02:00 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:02:00 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLAimNIpGvJxJ2K7x8_hYJlXVV3qbjMTDXN3Xm447JCUfxZDn-Wf0sl4YUvlfGEuUHZqEnw9ZwrHlGRKKi38xTuTU3GwUFRksR_fDEaBtrl_61Nk7ZcffAI89Uw3GQZ3tj6UHny8Z7R-nkYcye6xq1TYYcwo_Vs_FB25z0QmbgeF8b0 Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Project-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}] Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Tenant-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 02:02:00 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 02:02:00 user devstack@n-api.service[61836]: X-User: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 02:02:00 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:02:00 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:02:00 user devstack@n-api.service[61836]: X-User-Id: eeb5f26be86e43b3b61fff98fdc83cf3 Apr 14 02:02:00 user devstack@n-api.service[61836]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 02:02:00 user devstack@n-api.service[61836]: method: > Apr 14 02:02:00 user devstack@n-api.service[61836]: exception: Instance fa29c144-0ff9-4efb-a574-f521d18f08fa could not be found. Apr 14 02:02:00 user devstack@n-api.service[61836]: action_args: {'id': 'fa29c144-0ff9-4efb-a574-f521d18f08fa'} Apr 14 02:02:00 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa29c144-0ff9-4efb-a574-f521d18f08fa could not be found. Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa29c144-0ff9-4efb-a574-f521d18f08fa could not be found. Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa29c144-0ff9-4efb-a574-f521d18f08fa could not be found. Apr 14 02:02:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Returning 404 to user: Instance fa29c144-0ff9-4efb-a574-f521d18f08fa could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:02:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-5bc6212b-4905-4ba4-a4ed-3f06fe037fee tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa" status: 404 len: 111 microversion: 2.1 time: 0.170358 Apr 14 02:02:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 289/859] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:02:00 2023] GET /compute/v2.1/servers/fa29c144-0ff9-4efb-a574-f521d18f08fa => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:02:00 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:00 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:00 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:00 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:00 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:00 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:00 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:00 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:00 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:02:00 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc" status: 204 len: 0 microversion: 2.1 time: 0.120222 Apr 14 02:02:00 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 285/860] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:02:00 2023] DELETE /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:02:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:00 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:00 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:02:00 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3c8fd2f6-c63e-401d-aed1-bdfa9475d2c9 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc" status: 200 len: 1509 microversion: 2.1 time: 0.232549 Apr 14 02:02:00 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 287/861] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:02:00 2023] GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-unplugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] Creating event network-vif-unplugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 02:02:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050641 Apr 14 02:02:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 290/862] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:02 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-deleted", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:02 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] Creating event network-vif-deleted:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 02:02:02 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034351 Apr 14 02:02:02 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 286/863] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:02 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a19a1c08-5454-481b-bb5a-70c39ead9afc", "name": "network-vif-plugged", "status": "completed", "tag": "2b00fd21-ee22-48c1-beb5-66e60de9876a"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:02 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] Creating event network-vif-plugged:2b00fd21-ee22-48c1-beb5-66e60de9876a for instance a19a1c08-5454-481b-bb5a-70c39ead9afc on user Apr 14 02:02:02 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032021 Apr 14 02:02:02 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 288/864] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-1dd8f336-a563-4f8f-a91f-25bd7b6933bf tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:05 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-1dd8f336-a563-4f8f-a91f-25bd7b6933bf tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1dd8f336-a563-4f8f-a91f-25bd7b6933bf tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1dd8f336-a563-4f8f-a91f-25bd7b6933bf tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1dd8f336-a563-4f8f-a91f-25bd7b6933bf tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1dd8f336-a563-4f8f-a91f-25bd7b6933bf tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1dd8f336-a563-4f8f-a91f-25bd7b6933bf tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1dd8f336-a563-4f8f-a91f-25bd7b6933bf tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-1dd8f336-a563-4f8f-a91f-25bd7b6933bf tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.107001 Apr 14 02:02:05 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 291/865] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 02:02:05 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:02:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:05 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:05 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:02:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 204 len: 0 microversion: 2.20 time: 0.139076 Apr 14 02:02:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 287/866] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 02:02:05 2023] DELETE /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 02:02:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:05 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:06 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:02:06 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:02:06 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:02:06 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-80ad547a-b442-4c2d-a651-3f71dfdd5075 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 200 len: 1712 microversion: 2.20 time: 0.276455 Apr 14 02:02:06 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 289/867] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 02:02:05 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 1712 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 02:02:06 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "name": "network-vif-unplugged", "status": "completed", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:06 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:06 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] Creating event network-vif-unplugged:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 02:02:06 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029332 Apr 14 02:02:06 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 292/868] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-e7f6ba30-f10a-49dd-bc1a-9d1aadc50129 req-862a2392-4719-4d67-9c97-5a06a6115532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "name": "network-vif-deleted", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-e7f6ba30-f10a-49dd-bc1a-9d1aadc50129 req-862a2392-4719-4d67-9c97-5a06a6115532 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-e7f6ba30-f10a-49dd-bc1a-9d1aadc50129 req-862a2392-4719-4d67-9c97-5a06a6115532 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-e7f6ba30-f10a-49dd-bc1a-9d1aadc50129 req-862a2392-4719-4d67-9c97-5a06a6115532 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-e7f6ba30-f10a-49dd-bc1a-9d1aadc50129 req-862a2392-4719-4d67-9c97-5a06a6115532 service nova] Creating event network-vif-deleted:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 02:02:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-e7f6ba30-f10a-49dd-bc1a-9d1aadc50129 req-862a2392-4719-4d67-9c97-5a06a6115532 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033782 Apr 14 02:02:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 288/869] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9152f969-e279-4182-aa0a-8534458acbca", "name": "network-vif-plugged", "status": "completed", "tag": "cb0b5d20-30a0-4636-82c8-0c7637d66465"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] Creating event network-vif-plugged:cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance 9152f969-e279-4182-aa0a-8534458acbca on user Apr 14 02:02:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030271 Apr 14 02:02:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 290/870] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=12 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:22 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-463cf3a5-d886-480f-8d90-a32dabbb80d6 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Action: 'create', calling method: .version_select at 0x7fd420c89bd0>, body: {"keypair": {"name": "tempest-TestStampPattern-610075453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN71XmYAhugQNhgl+EJR/4+t7AjKtKkpcGBG8gx2VPAwa0I3bKysgOFGLrmgG1OeFgwpiuJDroargohcSM2hH/0cqZkFOvlkmK46/6QQTJRBUwCSuTngzFe2HQ0i1G666A=="}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:22 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-463cf3a5-d886-480f-8d90-a32dabbb80d6 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting quotas for project 27dc405e16434633956ed2cd7e1791cd. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:02:22 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-463cf3a5-d886-480f-8d90-a32dabbb80d6 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting quotas for user 7ae5170969344b9fa5294231f8ffbe72 and project 27dc405e16434633956ed2cd7e1791cd. Resources: {'key_pairs'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:02:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-463cf3a5-d886-480f-8d90-a32dabbb80d6 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.256927 Apr 14 02:02:22 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 293/871] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:02:21 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:25 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:25 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:25 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-237482406", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "key_name": "tempest-TestStampPattern-610075453", "security_groups": [{"name": "tempest-secgroup-smoke-627372706"}], "networks": [{"uuid": "d099696f-2c31-4ce1-89d8-680d87d17b9b"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:25 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] validate_networks() for [('d099696f-2c31-4ce1-89d8-680d87d17b9b', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting quotas for project 27dc405e16434633956ed2cd7e1791cd. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting quotas for user 7ae5170969344b9fa5294231f8ffbe72 and project 27dc405e16434633956ed2cd7e1791cd. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:02:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:02:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.700640 Apr 14 02:02:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 289/872] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:02:25 2023] POST /compute/v2.1/servers => generated 403 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:02:26 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-93ab06da-05f2-4843-8a19-83d09a185ef3 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:26 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-93ab06da-05f2-4843-8a19-83d09a185ef3 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:26 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=10 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:26 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=18 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:26 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-93ab06da-05f2-4843-8a19-83d09a185ef3 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:02:26 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-93ab06da-05f2-4843-8a19-83d09a185ef3 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a" status: 200 len: 1235 microversion: 2.1 time: 0.073458 Apr 14 02:02:26 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 291/873] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:02:26 2023] GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a => generated 1235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:02:29 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b15ad5-341a-47f8-9e3e-5cec8a85098a", "tag": "18eed24e-8acb-457c-95b8-64c141faa4aa"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] Creating event network-changed:18eed24e-8acb-457c-95b8-64c141faa4aa for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a on user Apr 14 02:02:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034537 Apr 14 02:02:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 294/874] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:31 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b15ad5-341a-47f8-9e3e-5cec8a85098a", "name": "network-vif-plugged", "status": "completed", "tag": "18eed24e-8acb-457c-95b8-64c141faa4aa"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:31 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] Creating event network-vif-plugged:18eed24e-8acb-457c-95b8-64c141faa4aa for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a on user Apr 14 02:02:31 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037120 Apr 14 02:02:31 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 290/875] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:33 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b15ad5-341a-47f8-9e3e-5cec8a85098a", "name": "network-vif-plugged", "status": "completed", "tag": "18eed24e-8acb-457c-95b8-64c141faa4aa"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:33 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:33 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:33 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:33 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] Creating event network-vif-plugged:18eed24e-8acb-457c-95b8-64c141faa4aa for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a on user Apr 14 02:02:33 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041972 Apr 14 02:02:33 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 292/876] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:34 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:02:34 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-22167239-e4bb-4500-b87c-f825d00ecba9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 200 len: 1427 microversion: 2.1 time: 0.201815 Apr 14 02:02:34 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 295/877] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:02:34 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 1427 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-7f37b252-529b-45a0-ad2e-2a8a7ebb444a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-7f37b252-529b-45a0-ad2e-2a8a7ebb444a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7f37b252-529b-45a0-ad2e-2a8a7ebb444a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7f37b252-529b-45a0-ad2e-2a8a7ebb444a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7f37b252-529b-45a0-ad2e-2a8a7ebb444a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7f37b252-529b-45a0-ad2e-2a8a7ebb444a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7f37b252-529b-45a0-ad2e-2a8a7ebb444a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:45 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-7f37b252-529b-45a0-ad2e-2a8a7ebb444a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:45 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-7f37b252-529b-45a0-ad2e-2a8a7ebb444a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.113995 Apr 14 02:02:45 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 291/878] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 02:02:45 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-interface => generated 282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:46 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:46 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:46 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:46 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c5d54a-48a6-4600-b87b-e1318e35c1fe", "tag": "617da89e-c0c3-455c-992f-893a43fa7d3e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:46 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] Creating event network-changed:617da89e-c0c3-455c-992f-893a43fa7d3e for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe on user Apr 14 02:02:46 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046275 Apr 14 02:02:46 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 293/879] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-59e2d292-36db-4ca8-81c4-e748ee1e611f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-59e2d292-36db-4ca8-81c4-e748ee1e611f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-59e2d292-36db-4ca8-81c4-e748ee1e611f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-59e2d292-36db-4ca8-81c4-e748ee1e611f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-59e2d292-36db-4ca8-81c4-e748ee1e611f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-59e2d292-36db-4ca8-81c4-e748ee1e611f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-59e2d292-36db-4ca8-81c4-e748ee1e611f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:46 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-59e2d292-36db-4ca8-81c4-e748ee1e611f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:46 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-59e2d292-36db-4ca8-81c4-e748ee1e611f tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/ips" status: 200 len: 104 microversion: 2.1 time: 0.042546 Apr 14 02:02:46 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 296/880] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:02:46 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/ips => generated 104 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97ad20ea-9d0f-482a-944e-c43cdf18b5aa"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:49 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298849 Apr 14 02:02:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 292/881] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:02:49 2023] POST /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] HTTP exception thrown: Instance a19a1c08-5454-481b-bb5a-70c39ead9afc could not be found. Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Request method failure captured: Apr 14 02:02:50 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc HTTP/1.1 Apr 14 02:02:50 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:02:50 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:02:50 user devstack@n-api.service[61837]: Connection: close Apr 14 02:02:50 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:02:50 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:02:50 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:02:50 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:02:50 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLAimNIpGvJxJ2K7x8_hYJlXVV3qbjMTDXN3Xm447JCUfxZDn-Wf0sl4YUvlfGEuUHZqEnw9ZwrHlGRKKi38xTuTU3GwUFRksR_fDEaBtrl_61Nk7ZcffAI89Uw3GQZ3tj6UHny8Z7R-nkYcye6xq1TYYcwo_Vs_FB25z0QmbgeF8b0 Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Project-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d3de04739384e3ea3a475fee28be3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d3de04739384e3ea3a475fee28be3c0"}]}] Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Tenant-Id: 6d3de04739384e3ea3a475fee28be3c0 Apr 14 02:02:50 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453869246 Apr 14 02:02:50 user devstack@n-api.service[61837]: X-User: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 02:02:50 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:02:50 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:02:50 user devstack@n-api.service[61837]: X-User-Id: eeb5f26be86e43b3b61fff98fdc83cf3 Apr 14 02:02:50 user devstack@n-api.service[61837]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453869246-project-member Apr 14 02:02:50 user devstack@n-api.service[61837]: method: > Apr 14 02:02:50 user devstack@n-api.service[61837]: exception: Instance a19a1c08-5454-481b-bb5a-70c39ead9afc could not be found. Apr 14 02:02:50 user devstack@n-api.service[61837]: action_args: {'id': 'a19a1c08-5454-481b-bb5a-70c39ead9afc'} Apr 14 02:02:50 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a19a1c08-5454-481b-bb5a-70c39ead9afc could not be found. Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a19a1c08-5454-481b-bb5a-70c39ead9afc could not be found. Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a19a1c08-5454-481b-bb5a-70c39ead9afc could not be found. Apr 14 02:02:50 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:02:50 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Returning 404 to user: Instance a19a1c08-5454-481b-bb5a-70c39ead9afc could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:02:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-2efd6dc1-d21f-46df-bfa5-58ce7412b341 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc" status: 404 len: 111 microversion: 2.1 time: 0.028134 Apr 14 02:02:50 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 294/882] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:02:50 2023] GET /compute/v2.1/servers/a19a1c08-5454-481b-bb5a-70c39ead9afc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:56 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] HTTP exception thrown: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Request method failure captured: Apr 14 02:02:56 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca HTTP/1.1 Apr 14 02:02:56 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:02:56 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:02:56 user devstack@n-api.service[61836]: Connection: close Apr 14 02:02:56 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:02:56 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:02:56 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:02:56 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:02:56 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLESjFhKG88rLDkmHrqgOJCWkMLjw5tkdR2QSGJfas1kpAouNy_OOp95xzeBrsiyUyzu9EsCTdTm27qQ9BBh9nKD9dNrpGKgvxr5fZVK_jptAggg2sJymOLPiGjgNS-KDPe7oze1h_WjICjAyGUkt3cTz1uVOtSb24dL-6jqrDJL-k0 Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Project-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}] Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Tenant-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:02:56 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:02:56 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:02:56 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:02:56 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:02:56 user devstack@n-api.service[61836]: X-User-Id: 2a5da3e233c74524a953ce0d4e074077 Apr 14 02:02:56 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:02:56 user devstack@n-api.service[61836]: method: > Apr 14 02:02:56 user devstack@n-api.service[61836]: exception: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:02:56 user devstack@n-api.service[61836]: action_args: {'id': '9152f969-e279-4182-aa0a-8534458acbca'} Apr 14 02:02:56 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:02:56 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:02:56 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Returning 404 to user: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:02:56 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f2f29d36-1fe9-49de-87fe-3d746e4052c2 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 404 len: 111 microversion: 2.20 time: 0.027331 Apr 14 02:02:56 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 297/883] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 02:02:56 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:02:56 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-014884e6-8844-41c7-814c-d8f18455dcd5 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '.version_select at 0x7fd420ed7ac0>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:56 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-014884e6-8844-41c7-814c-d8f18455dcd5 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419165173" status: 204 len: 0 microversion: 2.20 time: 0.023468 Apr 14 02:02:56 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 293/884] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 02:02:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419165173 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 02:02:57 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-7136a637-d5df-4386-95ab-425452161da7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:57 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-7136a637-d5df-4386-95ab-425452161da7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7136a637-d5df-4386-95ab-425452161da7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7136a637-d5df-4386-95ab-425452161da7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7136a637-d5df-4386-95ab-425452161da7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7136a637-d5df-4386-95ab-425452161da7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7136a637-d5df-4386-95ab-425452161da7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7136a637-d5df-4386-95ab-425452161da7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:57 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-7136a637-d5df-4386-95ab-425452161da7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063632 Apr 14 02:02:57 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 295/885] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:02:57 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:57 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3b42e75d-275e-41ea-be84-691ddfb726dd tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:02:57 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-3b42e75d-275e-41ea-be84-691ddfb726dd tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b42e75d-275e-41ea-be84-691ddfb726dd tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b42e75d-275e-41ea-be84-691ddfb726dd tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b42e75d-275e-41ea-be84-691ddfb726dd tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b42e75d-275e-41ea-be84-691ddfb726dd tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b42e75d-275e-41ea-be84-691ddfb726dd tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3b42e75d-275e-41ea-be84-691ddfb726dd tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-3b42e75d-275e-41ea-be84-691ddfb726dd tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/97ad20ea-9d0f-482a-944e-c43cdf18b5aa" status: 200 len: 194 microversion: 2.1 time: 0.068977 Apr 14 02:02:57 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 298/886] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 02:02:57 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/97ad20ea-9d0f-482a-944e-c43cdf18b5aa => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:02:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:02:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41242a52-99d3-435b-aef0-48d05e966fc0"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:02:59 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:02:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:02:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:02:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:02:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331391 Apr 14 02:02:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 294/887] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:02:59 2023] POST /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:00 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] HTTP exception thrown: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Request method failure captured: Apr 14 02:03:00 user devstack@n-api.service[61837]: request: DELETE /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca HTTP/1.1 Apr 14 02:03:00 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:03:00 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:03:00 user devstack@n-api.service[61837]: Connection: close Apr 14 02:03:00 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:03:00 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:03:00 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:03:00 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:03:00 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLESjFhKG88rLDkmHrqgOJCWkMLjw5tkdR2QSGJfas1kpAouNy_OOp95xzeBrsiyUyzu9EsCTdTm27qQ9BBh9nKD9dNrpGKgvxr5fZVK_jptAggg2sJymOLPiGjgNS-KDPe7oze1h_WjICjAyGUkt3cTz1uVOtSb24dL-6jqrDJL-k0 Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Project-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}] Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Tenant-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:03:00 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:00 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:03:00 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:03:00 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:03:00 user devstack@n-api.service[61837]: X-User-Id: 2a5da3e233c74524a953ce0d4e074077 Apr 14 02:03:00 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:03:00 user devstack@n-api.service[61837]: method: > Apr 14 02:03:00 user devstack@n-api.service[61837]: exception: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61837]: action_args: {'id': '9152f969-e279-4182-aa0a-8534458acbca'} Apr 14 02:03:00 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Returning 404 to user: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:03:00 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-cfc2af44-1b57-4fc9-83ea-340848ef0b48 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 404 len: 111 microversion: 2.20 time: 0.029576 Apr 14 02:03:00 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 296/888] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 02:03:00 2023] DELETE /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] HTTP exception thrown: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Request method failure captured: Apr 14 02:03:00 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca HTTP/1.1 Apr 14 02:03:00 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:03:00 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:03:00 user devstack@n-api.service[61836]: Connection: close Apr 14 02:03:00 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:03:00 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:03:00 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:03:00 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:03:00 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLESjFhKG88rLDkmHrqgOJCWkMLjw5tkdR2QSGJfas1kpAouNy_OOp95xzeBrsiyUyzu9EsCTdTm27qQ9BBh9nKD9dNrpGKgvxr5fZVK_jptAggg2sJymOLPiGjgNS-KDPe7oze1h_WjICjAyGUkt3cTz1uVOtSb24dL-6jqrDJL-k0 Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Project-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}] Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Tenant-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:03:00 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:00 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:03:00 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:03:00 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:03:00 user devstack@n-api.service[61836]: X-User-Id: 2a5da3e233c74524a953ce0d4e074077 Apr 14 02:03:00 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:03:00 user devstack@n-api.service[61836]: method: > Apr 14 02:03:00 user devstack@n-api.service[61836]: exception: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61836]: action_args: {'id': '9152f969-e279-4182-aa0a-8534458acbca'} Apr 14 02:03:00 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. Apr 14 02:03:00 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:03:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Returning 404 to user: Instance 9152f969-e279-4182-aa0a-8534458acbca could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:03:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-3ed34369-3ca4-4670-853b-5e8107101c21 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca" status: 404 len: 111 microversion: 2.20 time: 0.029451 Apr 14 02:03:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 299/889] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 02:03:00 2023] GET /compute/v2.1/servers/9152f969-e279-4182-aa0a-8534458acbca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:03 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] HTTP exception thrown: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Request method failure captured: Apr 14 02:03:03 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 HTTP/1.1 Apr 14 02:03:03 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:03:03 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:03:03 user devstack@n-api.service[61835]: Connection: close Apr 14 02:03:03 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:03:03 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:03:03 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:03:03 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:03:03 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLESjFhKG88rLDkmHrqgOJCWkMLjw5tkdR2QSGJfas1kpAouNy_OOp95xzeBrsiyUyzu9EsCTdTm27qQ9BBh9nKD9dNrpGKgvxr5fZVK_jptAggg2sJymOLPiGjgNS-KDPe7oze1h_WjICjAyGUkt3cTz1uVOtSb24dL-6jqrDJL-k0 Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Project-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}] Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Tenant-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:03:03 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:03 user devstack@n-api.service[61835]: X-User: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:03:03 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:03:03 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:03:03 user devstack@n-api.service[61835]: X-User-Id: 2a5da3e233c74524a953ce0d4e074077 Apr 14 02:03:03 user devstack@n-api.service[61835]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:03:03 user devstack@n-api.service[61835]: method: > Apr 14 02:03:03 user devstack@n-api.service[61835]: exception: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61835]: action_args: {'id': '18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80'} Apr 14 02:03:03 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Returning 404 to user: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:03:03 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-da5c51e6-f27c-4aa8-8451-285939c3ed02 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 404 len: 111 microversion: 2.20 time: 0.035649 Apr 14 02:03:03 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 295/890] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 02:03:03 2023] DELETE /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] HTTP exception thrown: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Request method failure captured: Apr 14 02:03:03 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 HTTP/1.1 Apr 14 02:03:03 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:03:03 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:03:03 user devstack@n-api.service[61837]: Connection: close Apr 14 02:03:03 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:03:03 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:03:03 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:03:03 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:03:03 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLESjFhKG88rLDkmHrqgOJCWkMLjw5tkdR2QSGJfas1kpAouNy_OOp95xzeBrsiyUyzu9EsCTdTm27qQ9BBh9nKD9dNrpGKgvxr5fZVK_jptAggg2sJymOLPiGjgNS-KDPe7oze1h_WjICjAyGUkt3cTz1uVOtSb24dL-6jqrDJL-k0 Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Project-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d05ca328d64f2aa1d19550475edba3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d05ca328d64f2aa1d19550475edba3"}]}] Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Tenant-Id: a6d05ca328d64f2aa1d19550475edba3 Apr 14 02:03:03 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2042065984 Apr 14 02:03:03 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:03:03 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:03:03 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:03:03 user devstack@n-api.service[61837]: X-User-Id: 2a5da3e233c74524a953ce0d4e074077 Apr 14 02:03:03 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2042065984-project-member Apr 14 02:03:03 user devstack@n-api.service[61837]: method: > Apr 14 02:03:03 user devstack@n-api.service[61837]: exception: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61837]: action_args: {'id': '18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80'} Apr 14 02:03:03 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. Apr 14 02:03:03 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:03:03 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Returning 404 to user: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:03:03 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-732865bb-1246-4697-98b3-86ae51f2c154 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" status: 404 len: 111 microversion: 2.20 time: 0.049361 Apr 14 02:03:03 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 297/891] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 02:03:03 2023] GET /compute/v2.1/servers/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:03:07 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ecebcad0-8f94-470b-b229-90b29fec533e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:07 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ecebcad0-8f94-470b-b229-90b29fec533e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ecebcad0-8f94-470b-b229-90b29fec533e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ecebcad0-8f94-470b-b229-90b29fec533e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ecebcad0-8f94-470b-b229-90b29fec533e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ecebcad0-8f94-470b-b229-90b29fec533e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ecebcad0-8f94-470b-b229-90b29fec533e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ecebcad0-8f94-470b-b229-90b29fec533e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ecebcad0-8f94-470b-b229-90b29fec533e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056318 Apr 14 02:03:07 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 300/892] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:03:07 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a9a487a3-c579-4701-b411-15c38bade394 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:07 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a9a487a3-c579-4701-b411-15c38bade394 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a9a487a3-c579-4701-b411-15c38bade394 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a9a487a3-c579-4701-b411-15c38bade394 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a9a487a3-c579-4701-b411-15c38bade394 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a9a487a3-c579-4701-b411-15c38bade394 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a9a487a3-c579-4701-b411-15c38bade394 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a9a487a3-c579-4701-b411-15c38bade394 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a9a487a3-c579-4701-b411-15c38bade394 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/97ad20ea-9d0f-482a-944e-c43cdf18b5aa" status: 200 len: 194 microversion: 2.1 time: 0.046761 Apr 14 02:03:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 296/893] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 02:03:07 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/97ad20ea-9d0f-482a-944e-c43cdf18b5aa => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:07 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:07 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:07 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:07 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'services' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:03:07 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/97ad20ea-9d0f-482a-944e-c43cdf18b5aa" status: 202 len: 0 microversion: 2.1 time: 0.245331 Apr 14 02:03:07 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 298/894] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:03:07 2023] DELETE /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/97ad20ea-9d0f-482a-944e-c43cdf18b5aa => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:03:11 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ae0e7d2b-de2d-4cb5-a4d0-482fdd5d0496 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:11 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ae0e7d2b-de2d-4cb5-a4d0-482fdd5d0496 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae0e7d2b-de2d-4cb5-a4d0-482fdd5d0496 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae0e7d2b-de2d-4cb5-a4d0-482fdd5d0496 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae0e7d2b-de2d-4cb5-a4d0-482fdd5d0496 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae0e7d2b-de2d-4cb5-a4d0-482fdd5d0496 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae0e7d2b-de2d-4cb5-a4d0-482fdd5d0496 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ae0e7d2b-de2d-4cb5-a4d0-482fdd5d0496 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ae0e7d2b-de2d-4cb5-a4d0-482fdd5d0496 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/41242a52-99d3-435b-aef0-48d05e966fc0" status: 200 len: 194 microversion: 2.1 time: 0.052219 Apr 14 02:03:11 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 301/895] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 02:03:11 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/41242a52-99d3-435b-aef0-48d05e966fc0 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:11 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:11 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'services' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:03:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/41242a52-99d3-435b-aef0-48d05e966fc0" status: 202 len: 0 microversion: 2.1 time: 0.166239 Apr 14 02:03:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 297/896] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:03:11 2023] DELETE /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments/41242a52-99d3-435b-aef0-48d05e966fc0 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1460124092", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] validate_networks() for [('1cdc7ce4-e3ce-4e21-834b-712724a6c11d', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:03:13 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-b83e95fe-e3c8-4bfd-85f2-a97a21d5e8a7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:13 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b83e95fe-e3c8-4bfd-85f2-a97a21d5e8a7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b83e95fe-e3c8-4bfd-85f2-a97a21d5e8a7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b83e95fe-e3c8-4bfd-85f2-a97a21d5e8a7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b83e95fe-e3c8-4bfd-85f2-a97a21d5e8a7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b83e95fe-e3c8-4bfd-85f2-a97a21d5e8a7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b83e95fe-e3c8-4bfd-85f2-a97a21d5e8a7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b83e95fe-e3c8-4bfd-85f2-a97a21d5e8a7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Getting quotas for project 3fba8f38142a41928f0d2e8ead3aab96. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Getting quotas for user fbb0e166c1f448cbba774b835f9798c9 and project 3fba8f38142a41928f0d2e8ead3aab96. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:03:13 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:03:13 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.492939 Apr 14 02:03:13 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 299/897] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:03:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:03:13 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c216ebb3-d7a0-4d8c-a603-13e2d7bb78e8 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:13 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-c216ebb3-d7a0-4d8c-a603-13e2d7bb78e8 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-c216ebb3-d7a0-4d8c-a603-13e2d7bb78e8 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb0e166c1f448cbba774b835f9798c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba8f38142a41928f0d2e8ead3aab96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:03:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-c216ebb3-d7a0-4d8c-a603-13e2d7bb78e8 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267" status: 200 len: 1213 microversion: 2.1 time: 0.070457 Apr 14 02:03:14 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 298/898] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:03:13 2023] GET /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:03:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b83e95fe-e3c8-4bfd-85f2-a97a21d5e8a7 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.340031 Apr 14 02:03:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 302/899] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:03:13 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments => generated 25 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:03:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-88ba6524-aacd-444d-87ab-f46ed652fd6e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:14 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-88ba6524-aacd-444d-87ab-f46ed652fd6e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88ba6524-aacd-444d-87ab-f46ed652fd6e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88ba6524-aacd-444d-87ab-f46ed652fd6e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88ba6524-aacd-444d-87ab-f46ed652fd6e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88ba6524-aacd-444d-87ab-f46ed652fd6e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88ba6524-aacd-444d-87ab-f46ed652fd6e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88ba6524-aacd-444d-87ab-f46ed652fd6e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-88ba6524-aacd-444d-87ab-f46ed652fd6e tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048317 Apr 14 02:03:14 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 300/900] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:03:14 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:14 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:03:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe" status: 204 len: 0 microversion: 2.1 time: 0.192436 Apr 14 02:03:14 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 299/901] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:03:14 2023] DELETE /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:03:14 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:14 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:14 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:03:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-736215c0-e881-4aee-a952-01f76f24fab0 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe" status: 200 len: 1662 microversion: 2.1 time: 0.192834 Apr 14 02:03:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 303/902] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:03:14 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe => generated 1662 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:03:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c5d54a-48a6-4600-b87b-e1318e35c1fe", "name": "network-vif-unplugged", "status": "completed", "tag": "617da89e-c0c3-455c-992f-893a43fa7d3e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] Creating event network-vif-unplugged:617da89e-c0c3-455c-992f-893a43fa7d3e for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe on user Apr 14 02:03:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032263 Apr 14 02:03:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 301/903] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:16 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:03:16 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-91712984-77bd-4b58-b899-f213fd79342b tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a" status: 200 len: 1535 microversion: 2.1 time: 0.189908 Apr 14 02:03:16 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 300/904] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:03:16 2023] GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a => generated 1535 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:03:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c5d54a-48a6-4600-b87b-e1318e35c1fe", "name": "network-vif-plugged", "status": "completed", "tag": "617da89e-c0c3-455c-992f-893a43fa7d3e"}, {"server_uuid": "b7c5d54a-48a6-4600-b87b-e1318e35c1fe", "name": "network-vif-deleted", "tag": "617da89e-c0c3-455c-992f-893a43fa7d3e"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:17 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=17 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:17 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=39 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] Creating event network-vif-plugged:617da89e-c0c3-455c-992f-893a43fa7d3e for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe on user Apr 14 02:03:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] Creating event network-vif-deleted:617da89e-c0c3-455c-992f-893a43fa7d3e for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe on user Apr 14 02:03:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038585 Apr 14 02:03:17 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 304/905] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a231fc48-a73e-4967-90c1-a31793235267", "tag": "abd5445b-2a67-4861-9840-b88f47390eb7"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:17 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:17 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] Creating event network-changed:abd5445b-2a67-4861-9840-b88f47390eb7 for instance a231fc48-a73e-4967-90c1-a31793235267 on user Apr 14 02:03:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038632 Apr 14 02:03:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 302/906] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:19 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a231fc48-a73e-4967-90c1-a31793235267", "name": "network-vif-plugged", "status": "completed", "tag": "abd5445b-2a67-4861-9840-b88f47390eb7"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] Creating event network-vif-plugged:abd5445b-2a67-4861-9840-b88f47390eb7 for instance a231fc48-a73e-4967-90c1-a31793235267 on user Apr 14 02:03:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031464 Apr 14 02:03:19 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 301/907] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:21 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a231fc48-a73e-4967-90c1-a31793235267", "name": "network-vif-plugged", "status": "completed", "tag": "abd5445b-2a67-4861-9840-b88f47390eb7"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] Creating event network-vif-plugged:abd5445b-2a67-4861-9840-b88f47390eb7 for instance a231fc48-a73e-4967-90c1-a31793235267 on user Apr 14 02:03:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030802 Apr 14 02:03:21 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 305/908] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e4e2138e-cc04-4408-aa6f-cf4f6838edb2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e4e2138e-cc04-4408-aa6f-cf4f6838edb2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e4e2138e-cc04-4408-aa6f-cf4f6838edb2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e4e2138e-cc04-4408-aa6f-cf4f6838edb2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e4e2138e-cc04-4408-aa6f-cf4f6838edb2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e4e2138e-cc04-4408-aa6f-cf4f6838edb2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e4e2138e-cc04-4408-aa6f-cf4f6838edb2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e4e2138e-cc04-4408-aa6f-cf4f6838edb2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e4e2138e-cc04-4408-aa6f-cf4f6838edb2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.096751 Apr 14 02:03:34 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 303/909] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 02:03:34 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065/os-interface => generated 282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:35 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:35 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:35 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:35 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba29111-1e9b-4947-b046-6bbe888eca06", "tag": "5b8a0a31-9ecf-4b31-a458-778005d846f4"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] Creating event network-changed:5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance 5ba29111-1e9b-4947-b046-6bbe888eca06 on user Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035516 Apr 14 02:03:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 302/910] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:36 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:03:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c1d5b76a-cb60-4f39-ba2c-631dabaacb49 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 200 len: 1427 microversion: 2.1 time: 0.212058 Apr 14 02:03:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 306/911] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:03:35 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 1427 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Old instance type m1.nano, new instance type m1.micro {{(pid=61837) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting quotas for user 78ccd1a1ec1b486981d850881734fe02 and project 2ed4ed4ab2fd4c14b3e2afe343fd7256. Resources: {'ram', 'cores'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:03:36 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:03:36 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065/action" status: 202 len: 0 microversion: 2.1 time: 0.203652 Apr 14 02:03:36 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 304/912] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:03:36 2023] POST /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:03:36 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:03:36 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:03:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:36 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:36 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:03:36 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-78e00c74-2a07-438e-bd0c-5c1dec6321b5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 200 len: 1436 microversion: 2.1 time: 0.144751 Apr 14 02:03:36 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 303/913] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:03:36 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 1436 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:03:37 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:37 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] Creating event network-changed:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:03:37 user devstack@n-api.service[61836]: DEBUG nova.compute.api [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61836) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 02:03:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040060 Apr 14 02:03:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 307/914] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:40 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "name": "network-vif-unplugged", "status": "completed", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}, {"server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "name": "network-vif-plugged", "status": "completed", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Creating event network-vif-unplugged:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:03:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Creating event network-vif-plugged:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:03:40 user devstack@n-api.service[61837]: DEBUG nova.compute.api [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61837) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 02:03:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042202 Apr 14 02:03:40 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 305/915] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:40 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "name": "network-vif-plugged", "status": "completed", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:49 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:49 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] Creating event network-vif-plugged:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:03:49 user devstack@n-api.service[61835]: DEBUG nova.compute.api [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61835) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 02:03:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045428 Apr 14 02:03:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 304/916] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:03:51 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:51 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=10 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:03:51 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "name": "network-vif-plugged", "status": "completed", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:03:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:03:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:03:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:03:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] Creating event network-vif-plugged:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:03:51 user devstack@n-api.service[61836]: DEBUG nova.compute.api [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61836) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 02:03:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043970 Apr 14 02:03:51 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 308/917] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:03:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=18 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:04 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb0e166c1f448cbba774b835f9798c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba8f38142a41928f0d2e8ead3aab96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:04:04 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-3c177f4c-e7bc-4498-80fc-3512bb0dc3c0 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267" status: 200 len: 1494 microversion: 2.1 time: 0.156091 Apr 14 02:04:04 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 306/918] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:04:04 2023] GET /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267 => generated 1494 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HTTP exception thrown: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Request method failure captured: Apr 14 02:04:05 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe HTTP/1.1 Apr 14 02:04:05 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:04:05 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:04:05 user devstack@n-api.service[61835]: Connection: close Apr 14 02:04:05 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:04:05 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:04:05 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:04:05 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:04:05 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLFldGo9jZhTmb_tN--IRSA9XgJtaMoTswawgwTx52Sao35ycMIOPAi4xnlNHb2wveuwGUTl8mo6SU_tBLN_Qz4XqZCaHCChiFRiaNMUjSsXQGI_pglqWVcDbLJ8q1LWcpaiRlz-NrpuyMb47K8Lt8fGMjPYSK-ZYV9FyIY_IUNkMMw Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Project-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Project-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}] Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Tenant: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Tenant-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:05 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:05 user devstack@n-api.service[61835]: X-User: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:05 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:04:05 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:04:05 user devstack@n-api.service[61835]: X-User-Id: ba0894753a074f99ab226fde0565dd28 Apr 14 02:04:05 user devstack@n-api.service[61835]: X-User-Name: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:05 user devstack@n-api.service[61835]: method: > Apr 14 02:04:05 user devstack@n-api.service[61835]: exception: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:05 user devstack@n-api.service[61835]: action_args: {'id': 'b7c5d54a-48a6-4600-b87b-e1318e35c1fe'} Apr 14 02:04:05 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:05 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Returning 404 to user: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:04:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b21150da-633c-4cab-b475-939cae15ba67 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe" status: 404 len: 111 microversion: 2.1 time: 0.065980 Apr 14 02:04:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 305/919] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:04:05 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:04:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-1d793425-d74d-429d-a60e-96543096da1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '.version_select at 0x7fd420e25630>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-1d793425-d74d-429d-a60e-96543096da1b tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642286085" status: 202 len: 0 microversion: 2.1 time: 0.025746 Apr 14 02:04:05 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 309/920] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 02:04:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642286085 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HTTP exception thrown: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Request method failure captured: Apr 14 02:04:12 user devstack@n-api.service[61837]: request: DELETE /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe HTTP/1.1 Apr 14 02:04:12 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:04:12 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:04:12 user devstack@n-api.service[61837]: Connection: close Apr 14 02:04:12 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:04:12 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:04:12 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:04:12 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:04:12 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLFldGo9jZhTmb_tN--IRSA9XgJtaMoTswawgwTx52Sao35ycMIOPAi4xnlNHb2wveuwGUTl8mo6SU_tBLN_Qz4XqZCaHCChiFRiaNMUjSsXQGI_pglqWVcDbLJ8q1LWcpaiRlz-NrpuyMb47K8Lt8fGMjPYSK-ZYV9FyIY_IUNkMMw Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Project-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}] Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Tenant-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:12 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:12 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:12 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:04:12 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:04:12 user devstack@n-api.service[61837]: X-User-Id: ba0894753a074f99ab226fde0565dd28 Apr 14 02:04:12 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:12 user devstack@n-api.service[61837]: method: > Apr 14 02:04:12 user devstack@n-api.service[61837]: exception: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61837]: action_args: {'id': 'b7c5d54a-48a6-4600-b87b-e1318e35c1fe'} Apr 14 02:04:12 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Returning 404 to user: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:04:12 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-6db58531-da8a-4905-b3be-26ea15a48209 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe" status: 404 len: 111 microversion: 2.1 time: 0.033029 Apr 14 02:04:12 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 307/921] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:04:12 2023] DELETE /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HTTP exception thrown: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Request method failure captured: Apr 14 02:04:12 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe HTTP/1.1 Apr 14 02:04:12 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:04:12 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:04:12 user devstack@n-api.service[61835]: Connection: close Apr 14 02:04:12 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:04:12 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:04:12 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:04:12 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:04:12 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLFldGo9jZhTmb_tN--IRSA9XgJtaMoTswawgwTx52Sao35ycMIOPAi4xnlNHb2wveuwGUTl8mo6SU_tBLN_Qz4XqZCaHCChiFRiaNMUjSsXQGI_pglqWVcDbLJ8q1LWcpaiRlz-NrpuyMb47K8Lt8fGMjPYSK-ZYV9FyIY_IUNkMMw Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Project-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Project-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}] Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Tenant: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Tenant-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:12 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:12 user devstack@n-api.service[61835]: X-User: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:12 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:04:12 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:04:12 user devstack@n-api.service[61835]: X-User-Id: ba0894753a074f99ab226fde0565dd28 Apr 14 02:04:12 user devstack@n-api.service[61835]: X-User-Name: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:12 user devstack@n-api.service[61835]: method: > Apr 14 02:04:12 user devstack@n-api.service[61835]: exception: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61835]: action_args: {'id': 'b7c5d54a-48a6-4600-b87b-e1318e35c1fe'} Apr 14 02:04:12 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. Apr 14 02:04:12 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:04:12 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Returning 404 to user: Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:04:12 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d7c1dad7-6092-457d-9dd6-fa8156960c2d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe" status: 404 len: 111 microversion: 2.1 time: 0.040598 Apr 14 02:04:12 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 306/922] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:04:12 2023] GET /compute/v2.1/servers/b7c5d54a-48a6-4600-b87b-e1318e35c1fe => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HTTP exception thrown: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Request method failure captured: Apr 14 02:04:15 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 HTTP/1.1 Apr 14 02:04:15 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:04:15 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:04:15 user devstack@n-api.service[61836]: Connection: close Apr 14 02:04:15 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:04:15 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:04:15 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:04:15 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:04:15 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLFldGo9jZhTmb_tN--IRSA9XgJtaMoTswawgwTx52Sao35ycMIOPAi4xnlNHb2wveuwGUTl8mo6SU_tBLN_Qz4XqZCaHCChiFRiaNMUjSsXQGI_pglqWVcDbLJ8q1LWcpaiRlz-NrpuyMb47K8Lt8fGMjPYSK-ZYV9FyIY_IUNkMMw Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Project-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}] Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Tenant-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:15 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:15 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:15 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:04:15 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:04:15 user devstack@n-api.service[61836]: X-User-Id: ba0894753a074f99ab226fde0565dd28 Apr 14 02:04:15 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:15 user devstack@n-api.service[61836]: method: > Apr 14 02:04:15 user devstack@n-api.service[61836]: exception: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61836]: action_args: {'id': '85b399dc-62df-480d-8561-5d9d1ab75c52'} Apr 14 02:04:15 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Returning 404 to user: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:04:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ca6e7c8e-5049-48d0-aa9c-a28c070ea7a9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 404 len: 111 microversion: 2.1 time: 0.035278 Apr 14 02:04:15 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 310/923] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:04:15 2023] DELETE /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HTTP exception thrown: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Request method failure captured: Apr 14 02:04:15 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 HTTP/1.1 Apr 14 02:04:15 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:04:15 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:04:15 user devstack@n-api.service[61837]: Connection: close Apr 14 02:04:15 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:04:15 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:04:15 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:04:15 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:04:15 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLFldGo9jZhTmb_tN--IRSA9XgJtaMoTswawgwTx52Sao35ycMIOPAi4xnlNHb2wveuwGUTl8mo6SU_tBLN_Qz4XqZCaHCChiFRiaNMUjSsXQGI_pglqWVcDbLJ8q1LWcpaiRlz-NrpuyMb47K8Lt8fGMjPYSK-ZYV9FyIY_IUNkMMw Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Project-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f650e04d2c947498b9e7a8d002862ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f650e04d2c947498b9e7a8d002862ad"}]}] Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Tenant-Id: 0f650e04d2c947498b9e7a8d002862ad Apr 14 02:04:15 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296004410 Apr 14 02:04:15 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:15 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:04:15 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:04:15 user devstack@n-api.service[61837]: X-User-Id: ba0894753a074f99ab226fde0565dd28 Apr 14 02:04:15 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeTestJSON-296004410-project-member Apr 14 02:04:15 user devstack@n-api.service[61837]: method: > Apr 14 02:04:15 user devstack@n-api.service[61837]: exception: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61837]: action_args: {'id': '85b399dc-62df-480d-8561-5d9d1ab75c52'} Apr 14 02:04:15 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. Apr 14 02:04:15 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:04:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Returning 404 to user: Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:04:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-74b328e5-733d-401a-8cd3-43dcbba5f6ec tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52" status: 404 len: 111 microversion: 2.1 time: 0.036068 Apr 14 02:04:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 308/924] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:04:15 2023] GET /compute/v2.1/servers/85b399dc-62df-480d-8561-5d9d1ab75c52 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:04:16 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:16 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:17 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:04:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ba5a0563-ec15-47d5-93a8-7f6bba999cd4 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a" status: 200 len: 1535 microversion: 2.1 time: 0.175278 Apr 14 02:04:17 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 307/925] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:04:16 2023] GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a => generated 1535 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:04:19 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b15ad5-341a-47f8-9e3e-5cec8a85098a", "tag": "18eed24e-8acb-457c-95b8-64c141faa4aa"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:04:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6e664bf-00ef-4bb1-835c-e96535d4bb32"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:04:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:19 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] Creating event network-changed:18eed24e-8acb-457c-95b8-64c141faa4aa for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a on user Apr 14 02:04:19 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152656 Apr 14 02:04:19 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 311/926] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:04:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:04:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306755 Apr 14 02:04:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 309/927] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:04:19 2023] POST /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:04:26 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:26 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:04:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-113ed4f6-3a8d-4fb1-8a5e-21a41f4fc5a9 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 200 len: 1553 microversion: 2.1 time: 0.146984 Apr 14 02:04:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 308/928] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:04:26 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:04:28 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:28 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:28 user devstack@n-api.service[61836]: DEBUG nova.objects.instance [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'services' on Instance uuid 57b15ad5-341a-47f8-9e3e-5cec8a85098a {{(pid=61836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:04:28 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments/d6e664bf-00ef-4bb1-835c-e96535d4bb32" status: 202 len: 0 microversion: 2.1 time: 0.162996 Apr 14 02:04:28 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 312/929] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:04:28 2023] DELETE /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments/d6e664bf-00ef-4bb1-835c-e96535d4bb32 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:04:28 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b56afa69-82bc-4071-9867-339bbac1ee87 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:04:28 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b56afa69-82bc-4071-9867-339bbac1ee87 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:04:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b56afa69-82bc-4071-9867-339bbac1ee87 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b56afa69-82bc-4071-9867-339bbac1ee87 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b56afa69-82bc-4071-9867-339bbac1ee87 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b56afa69-82bc-4071-9867-339bbac1ee87 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:04:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b56afa69-82bc-4071-9867-339bbac1ee87 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:04:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b56afa69-82bc-4071-9867-339bbac1ee87 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:04:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b56afa69-82bc-4071-9867-339bbac1ee87 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047001 Apr 14 02:04:28 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 310/930] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:04:28 2023] GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e30d5da-2923-47a9-9cb1-98605d191299", "device": "/dev/vdb"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=16 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:04 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:04 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406528 Apr 14 02:05:04 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 309/931] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:05:04 2023] POST /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-b1a4bd8b-f86c-4711-be31-f8b5231c2146 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b1a4bd8b-f86c-4711-be31-f8b5231c2146 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1a4bd8b-f86c-4711-be31-f8b5231c2146 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1a4bd8b-f86c-4711-be31-f8b5231c2146 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1a4bd8b-f86c-4711-be31-f8b5231c2146 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1a4bd8b-f86c-4711-be31-f8b5231c2146 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1a4bd8b-f86c-4711-be31-f8b5231c2146 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1a4bd8b-f86c-4711-be31-f8b5231c2146 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:18 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b1a4bd8b-f86c-4711-be31-f8b5231c2146 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056425 Apr 14 02:05:18 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 313/932] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:05:18 2023] GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-656805884"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=10 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/action" status: 202 len: 0 microversion: 2.1 time: 0.895682 Apr 14 02:05:21 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 311/933] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:05:20 2023] POST /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/action => generated 0 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065/action" status: 204 len: 0 microversion: 2.1 time: 0.091051 Apr 14 02:05:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 310/934] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:05:26 2023] POST /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:05:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:05:26 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:27 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:05:27 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b1d991e9-fc1a-4c74-9e5d-1342051a0883 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 200 len: 1553 microversion: 2.1 time: 0.172993 Apr 14 02:05:27 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 314/935] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:05:26 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'services' on Instance uuid a231fc48-a73e-4967-90c1-a31793235267 {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:05:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267/os-volume_attachments/8e30d5da-2923-47a9-9cb1-98605d191299" status: 202 len: 0 microversion: 2.1 time: 0.155757 Apr 14 02:05:30 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 312/936] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:05:30 2023] DELETE /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267/os-volume_attachments/8e30d5da-2923-47a9-9cb1-98605d191299 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:05:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:05:30 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:30 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:05:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267" status: 204 len: 0 microversion: 2.1 time: 0.117085 Apr 14 02:05:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 311/937] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:05:30 2023] DELETE /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:05:30 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:05:30 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:30 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb0e166c1f448cbba774b835f9798c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba8f38142a41928f0d2e8ead3aab96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:05:30 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ea4981df-7d76-412d-b498-ec4c421120ce tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267" status: 200 len: 1546 microversion: 2.1 time: 0.171625 Apr 14 02:05:30 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 315/938] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:05:30 2023] GET /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267 => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-835223747", "imageRef": "04ce4b97-8518-4303-b06d-8307b1cb09b8", "flavorRef": "42", "key_name": "tempest-TestStampPattern-610075453", "security_groups": [{"name": "tempest-secgroup-smoke-627372706"}], "networks": [{"uuid": "d099696f-2c31-4ce1-89d8-680d87d17b9b"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:30 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] validate_networks() for [('d099696f-2c31-4ce1-89d8-680d87d17b9b', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting quotas for project 27dc405e16434633956ed2cd7e1791cd. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting quotas for user 7ae5170969344b9fa5294231f8ffbe72 and project 27dc405e16434633956ed2cd7e1791cd. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:05:31 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='04ce4b97-8518-4303-b06d-8307b1cb09b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:05:31 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.666620 Apr 14 02:05:31 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 313/939] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:05:30 2023] POST /compute/v2.1/servers => generated 403 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:05:31 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-4ba7481f-7cd6-4507-85d3-5c5af416f432 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:05:31 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-4ba7481f-7cd6-4507-85d3-5c5af416f432 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:31 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-4ba7481f-7cd6-4507-85d3-5c5af416f432 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:05:31 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-4ba7481f-7cd6-4507-85d3-5c5af416f432 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" status: 200 len: 1235 microversion: 2.1 time: 0.071485 Apr 14 02:05:31 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 312/940] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:05:31 2023] GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => generated 1235 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:05:32 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a231fc48-a73e-4967-90c1-a31793235267", "name": "network-vif-unplugged", "status": "completed", "tag": "abd5445b-2a67-4861-9840-b88f47390eb7"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] Creating event network-vif-unplugged:abd5445b-2a67-4861-9840-b88f47390eb7 for instance a231fc48-a73e-4967-90c1-a31793235267 on user Apr 14 02:05:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049599 Apr 14 02:05:32 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 316/941] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:05:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:05:34 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a231fc48-a73e-4967-90c1-a31793235267", "name": "network-vif-plugged", "status": "completed", "tag": "abd5445b-2a67-4861-9840-b88f47390eb7"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] Creating event network-vif-plugged:abd5445b-2a67-4861-9840-b88f47390eb7 for instance a231fc48-a73e-4967-90c1-a31793235267 on user Apr 14 02:05:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041022 Apr 14 02:05:34 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 314/942] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:05:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:05:35 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570", "tag": "735565d4-21ba-4824-9dcb-d464456080fc"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] Creating event network-changed:735565d4-21ba-4824-9dcb-d464456080fc for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 on user Apr 14 02:05:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034432 Apr 14 02:05:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 313/943] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:05:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:05:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-11a0943d-e94f-45f8-997d-f04cfd83b0e9 req-4526c8a7-0fdc-440f-8896-76278fd11846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a231fc48-a73e-4967-90c1-a31793235267", "name": "network-vif-deleted", "tag": "abd5445b-2a67-4861-9840-b88f47390eb7"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-11a0943d-e94f-45f8-997d-f04cfd83b0e9 req-4526c8a7-0fdc-440f-8896-76278fd11846 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-11a0943d-e94f-45f8-997d-f04cfd83b0e9 req-4526c8a7-0fdc-440f-8896-76278fd11846 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:36 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-11a0943d-e94f-45f8-997d-f04cfd83b0e9 req-4526c8a7-0fdc-440f-8896-76278fd11846 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-11a0943d-e94f-45f8-997d-f04cfd83b0e9 req-4526c8a7-0fdc-440f-8896-76278fd11846 service nova] Creating event network-vif-deleted:abd5445b-2a67-4861-9840-b88f47390eb7 for instance a231fc48-a73e-4967-90c1-a31793235267 on user Apr 14 02:05:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-11a0943d-e94f-45f8-997d-f04cfd83b0e9 req-4526c8a7-0fdc-440f-8896-76278fd11846 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110611 Apr 14 02:05:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 317/944] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:05:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:05:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570", "name": "network-vif-plugged", "status": "completed", "tag": "735565d4-21ba-4824-9dcb-d464456080fc"}, {"server_uuid": "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570", "name": "network-vif-plugged", "status": "completed", "tag": "735565d4-21ba-4824-9dcb-d464456080fc"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Creating event network-vif-plugged:735565d4-21ba-4824-9dcb-d464456080fc for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 on user Apr 14 02:05:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Creating event network-vif-plugged:735565d4-21ba-4824-9dcb-d464456080fc for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 on user Apr 14 02:05:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033627 Apr 14 02:05:38 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 315/945] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:05:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-526115198", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "2995521b-e746-4035-ab0e-41d7ffde35cc"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] validate_networks() for [('2995521b-e746-4035-ab0e-41d7ffde35cc', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Getting quotas for project e7d826f5f9504efe95f0736f538951b4. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Getting quotas for user 97dc26d9782b4960af1ae5056a85616e and project e7d826f5f9504efe95f0736f538951b4. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:05:50 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:05:50 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.644485 Apr 14 02:05:50 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 314/946] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:05:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:05:50 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=10 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:50 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=22 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:50 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-768e3409-f4c1-4196-9b94-9d06ca92f40a tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:05:50 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-768e3409-f4c1-4196-9b94-9d06ca92f40a tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:05:50 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-768e3409-f4c1-4196-9b94-9d06ca92f40a tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dc26d9782b4960af1ae5056a85616e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d826f5f9504efe95f0736f538951b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:05:50 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-768e3409-f4c1-4196-9b94-9d06ca92f40a tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21" status: 200 len: 1207 microversion: 2.1 time: 0.178484 Apr 14 02:05:50 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 318/947] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:05:50 2023] GET /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21 => generated 1207 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:05:53 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:53 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:53 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:53 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:05:53 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd1bf0f2-5c22-4c42-9e19-b22343997d21", "tag": "adff1b77-9793-4fa2-8861-3bd2297c7841"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:53 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:53 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] Creating event network-changed:adff1b77-9793-4fa2-8861-3bd2297c7841 for instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 on user Apr 14 02:05:53 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040426 Apr 14 02:05:53 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 316/948] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:05:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:05:55 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1bf0f2-5c22-4c42-9e19-b22343997d21", "name": "network-vif-plugged", "status": "completed", "tag": "adff1b77-9793-4fa2-8861-3bd2297c7841"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:55 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:55 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] Creating event network-vif-plugged:adff1b77-9793-4fa2-8861-3bd2297c7841 for instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 on user Apr 14 02:05:55 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029256 Apr 14 02:05:55 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 315/949] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:05:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:05:57 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1bf0f2-5c22-4c42-9e19-b22343997d21", "name": "network-vif-plugged", "status": "completed", "tag": "adff1b77-9793-4fa2-8861-3bd2297c7841"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:05:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:05:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:05:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:05:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] Creating event network-vif-plugged:adff1b77-9793-4fa2-8861-3bd2297c7841 for instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 on user Apr 14 02:05:57 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028255 Apr 14 02:05:57 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 319/950] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:05:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:17 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:06:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f5d8a5bd-18b2-457a-9a31-8705f2bf8c0d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 200 len: 1545 microversion: 2.1 time: 0.213105 Apr 14 02:06:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 317/951] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:06:17 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 1545 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] HTTP exception thrown: Instance a231fc48-a73e-4967-90c1-a31793235267 could not be found. Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Request method failure captured: Apr 14 02:06:20 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267 HTTP/1.1 Apr 14 02:06:20 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:06:20 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:06:20 user devstack@n-api.service[61835]: Connection: close Apr 14 02:06:20 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:06:20 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:06:20 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:06:20 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:06:20 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLRcMU-ngZDNCTKDelVjBvSv9TOakXfOi99Gb2LAV5mbURPH2KnbE-nHkg_C1h6CBABXpx-JF6kMOoTjyt-MBEbabMJuOzDzF1B8SdBRMfcJC8B4FL8V8HowMGmK1ry1Ifb2O6zwxa1WmZ_JPVWUSrokhlxM2Nsd_J2v7yZwoS26mfY Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Project-Id: 3fba8f38142a41928f0d2e8ead3aab96 Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2121749885 Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fba8f38142a41928f0d2e8ead3aab96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3fba8f38142a41928f0d2e8ead3aab96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fba8f38142a41928f0d2e8ead3aab96"}]}] Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Tenant: tempest-VolumesSnapshotTestJSON-2121749885 Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Tenant-Id: 3fba8f38142a41928f0d2e8ead3aab96 Apr 14 02:06:20 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2121749885 Apr 14 02:06:20 user devstack@n-api.service[61835]: X-User: tempest-VolumesSnapshotTestJSON-2121749885-project-member Apr 14 02:06:20 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:06:20 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:06:20 user devstack@n-api.service[61835]: X-User-Id: fbb0e166c1f448cbba774b835f9798c9 Apr 14 02:06:20 user devstack@n-api.service[61835]: X-User-Name: tempest-VolumesSnapshotTestJSON-2121749885-project-member Apr 14 02:06:20 user devstack@n-api.service[61835]: method: > Apr 14 02:06:20 user devstack@n-api.service[61835]: exception: Instance a231fc48-a73e-4967-90c1-a31793235267 could not be found. Apr 14 02:06:20 user devstack@n-api.service[61835]: action_args: {'id': 'a231fc48-a73e-4967-90c1-a31793235267'} Apr 14 02:06:20 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a231fc48-a73e-4967-90c1-a31793235267 could not be found. Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a231fc48-a73e-4967-90c1-a31793235267 could not be found. Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a231fc48-a73e-4967-90c1-a31793235267 could not be found. Apr 14 02:06:20 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:06:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Returning 404 to user: Instance a231fc48-a73e-4967-90c1-a31793235267 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:06:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-335fd805-c793-44c8-b23b-509d8780e1c4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267" status: 404 len: 111 microversion: 2.1 time: 0.040770 Apr 14 02:06:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 316/952] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:06:20 2023] GET /compute/v2.1/servers/a231fc48-a73e-4967-90c1-a31793235267 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:21 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:06:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-73777063-9212-4cce-8224-5eff4bb239de tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" status: 200 len: 1536 microversion: 2.1 time: 0.178782 Apr 14 02:06:21 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 320/953] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:06:21 2023] GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => generated 1536 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-295651143", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "networks": [{"uuid": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] validate_networks() for [('1cdc7ce4-e3ce-4e21-834b-712724a6c11d', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Getting quotas for project 3fba8f38142a41928f0d2e8ead3aab96. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Getting quotas for user fbb0e166c1f448cbba774b835f9798c9 and project 3fba8f38142a41928f0d2e8ead3aab96. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:06:34 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:06:34 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.536679 Apr 14 02:06:34 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 318/954] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:06:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:06:34 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-aed748ae-903e-4e79-85fd-4a14a007cdb2 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:06:34 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-aed748ae-903e-4e79-85fd-4a14a007cdb2 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:06:34 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:34 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:34 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-aed748ae-903e-4e79-85fd-4a14a007cdb2 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb0e166c1f448cbba774b835f9798c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba8f38142a41928f0d2e8ead3aab96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:06:34 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-aed748ae-903e-4e79-85fd-4a14a007cdb2 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c" status: 200 len: 1212 microversion: 2.1 time: 0.076455 Apr 14 02:06:34 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 317/955] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:06:34 2023] GET /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:06:37 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:37 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:06:37 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63b62a9-626c-45ca-a454-4840f51bb28c", "tag": "92e48f25-5c12-4ff1-840d-54bee4da0ef2"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:06:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:37 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:37 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] Creating event network-changed:92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance c63b62a9-626c-45ca-a454-4840f51bb28c on user Apr 14 02:06:37 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095958 Apr 14 02:06:37 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 321/956] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:06:39 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63b62a9-626c-45ca-a454-4840f51bb28c", "name": "network-vif-plugged", "status": "completed", "tag": "92e48f25-5c12-4ff1-840d-54bee4da0ef2"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:06:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:39 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] Creating event network-vif-plugged:92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance c63b62a9-626c-45ca-a454-4840f51bb28c on user Apr 14 02:06:39 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126596 Apr 14 02:06:39 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 319/957] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:06:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:06:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:06:41 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:06:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:41 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dc26d9782b4960af1ae5056a85616e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d826f5f9504efe95f0736f538951b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:06:41 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-f29ecf79-4da8-4a59-a7f3-6f3cfad2c88c tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21" status: 200 len: 1484 microversion: 2.1 time: 0.242393 Apr 14 02:06:41 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 318/958] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:06:41 2023] GET /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21 => generated 1484 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:06:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63b62a9-626c-45ca-a454-4840f51bb28c", "name": "network-vif-plugged", "status": "completed", "tag": "92e48f25-5c12-4ff1-840d-54bee4da0ef2"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:06:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:06:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:06:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:06:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] Creating event network-vif-plugged:92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance c63b62a9-626c-45ca-a454-4840f51bb28c on user Apr 14 02:06:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029471 Apr 14 02:06:41 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 322/959] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:17 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:07:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-190a08da-09fc-45ac-8a18-7da4c342f8b2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 200 len: 1545 microversion: 2.1 time: 0.299750 Apr 14 02:07:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 320/960] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:07:17 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 1545 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:17 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065/action" status: 200 len: 28253 microversion: 2.1 time: 0.216719 Apr 14 02:07:17 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 319/961] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:07:17 2023] POST /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065/action => generated 28253 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:18 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:07:18 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-1f28749b-f874-4742-b94b-b04eb3d21b28 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06" status: 200 len: 1539 microversion: 2.1 time: 0.162158 Apr 14 02:07:18 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 323/962] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:07:18 2023] GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06 => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:07:21 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:07:21 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:22 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:07:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-69dbff8b-b0cc-49cf-bad2-40fc2a82f6af tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" status: 200 len: 1536 microversion: 2.1 time: 0.291633 Apr 14 02:07:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 321/963] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:07:21 2023] GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => generated 1536 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:07:23 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570", "tag": "735565d4-21ba-4824-9dcb-d464456080fc"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:07:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] Creating event network-changed:735565d4-21ba-4824-9dcb-d464456080fc for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 on user Apr 14 02:07:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030810 Apr 14 02:07:23 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 320/964] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:07:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:07:23 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c538a4c-d102-445d-bfef-2cb750d83cb9"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:07:23 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271204 Apr 14 02:07:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 324/965] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:07:23 2023] POST /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:07:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:07:24 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:24 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb0e166c1f448cbba774b835f9798c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba8f38142a41928f0d2e8ead3aab96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:07:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-c0f70d25-e1e1-460e-b7af-f4a9af0bae67 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c" status: 200 len: 1493 microversion: 2.1 time: 0.153198 Apr 14 02:07:24 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 322/966] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:07:24 2023] GET /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c => generated 1493 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:07:32 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:07:32 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:32 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'services' on Instance uuid 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:07:32 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/os-volume_attachments/4c538a4c-d102-445d-bfef-2cb750d83cb9" status: 202 len: 0 microversion: 2.1 time: 0.209600 Apr 14 02:07:32 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 321/967] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:07:32 2023] DELETE /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/os-volume_attachments/4c538a4c-d102-445d-bfef-2cb750d83cb9 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:07:32 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-bc586ef2-27eb-4a4e-912c-e9e9897e6467 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:07:32 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-bc586ef2-27eb-4a4e-912c-e9e9897e6467 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bc586ef2-27eb-4a4e-912c-e9e9897e6467 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bc586ef2-27eb-4a4e-912c-e9e9897e6467 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bc586ef2-27eb-4a4e-912c-e9e9897e6467 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bc586ef2-27eb-4a4e-912c-e9e9897e6467 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bc586ef2-27eb-4a4e-912c-e9e9897e6467 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-bc586ef2-27eb-4a4e-912c-e9e9897e6467 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-bc586ef2-27eb-4a4e-912c-e9e9897e6467 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074027 Apr 14 02:07:32 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 325/968] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:07:32 2023] GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=18 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:48 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:07:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21" status: 204 len: 0 microversion: 2.1 time: 0.130554 Apr 14 02:07:48 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 323/969] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:07:48 2023] DELETE /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:48 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dc26d9782b4960af1ae5056a85616e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d826f5f9504efe95f0736f538951b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:07:48 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5ec0e421-84bb-4be6-80fb-4029214c12f9 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21" status: 200 len: 1490 microversion: 2.1 time: 0.326297 Apr 14 02:07:48 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 322/970] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:07:48 2023] GET /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21 => generated 1490 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:07:48 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1bf0f2-5c22-4c42-9e19-b22343997d21", "name": "network-vif-unplugged", "status": "completed", "tag": "adff1b77-9793-4fa2-8861-3bd2297c7841"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:07:48 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:48 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:07:48 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:48 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:48 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:48 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] Creating event network-vif-unplugged:adff1b77-9793-4fa2-8861-3bd2297c7841 for instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 on user Apr 14 02:07:48 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040663 Apr 14 02:07:48 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 326/971] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:07:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:07:50 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd1bf0f2-5c22-4c42-9e19-b22343997d21", "name": "network-vif-plugged", "status": "completed", "tag": "adff1b77-9793-4fa2-8861-3bd2297c7841"}, {"server_uuid": "bd1bf0f2-5c22-4c42-9e19-b22343997d21", "name": "network-vif-deleted", "tag": "adff1b77-9793-4fa2-8861-3bd2297c7841"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:07:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:07:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:07:50 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:07:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] Creating event network-vif-plugged:adff1b77-9793-4fa2-8861-3bd2297c7841 for instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 on user Apr 14 02:07:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] Creating event network-vif-deleted:adff1b77-9793-4fa2-8861-3bd2297c7841 for instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 on user Apr 14 02:07:50 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032409 Apr 14 02:07:50 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 324/972] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:07:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:18 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:08:18 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 204 len: 0 microversion: 2.1 time: 0.121948 Apr 14 02:08:18 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 323/973] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:08:18 2023] DELETE /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:18 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:08:18 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-16ecd9f2-091e-48ce-9511-73cffbbdae25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 200 len: 1551 microversion: 2.1 time: 0.194081 Apr 14 02:08:18 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 327/974] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:08:18 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 1551 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:08:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:18 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "name": "network-vif-unplugged", "status": "completed", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:08:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:18 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] Creating event network-vif-unplugged:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:08:18 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042909 Apr 14 02:08:18 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 325/975] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:08:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:08:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "name": "network-vif-plugged", "status": "completed", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:08:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] Creating event network-vif-plugged:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:08:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041835 Apr 14 02:08:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 324/976] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:08:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:08:22 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-68d28ff8-3c33-4fa0-af50-b45db5b07626 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:08:22 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-68d28ff8-3c33-4fa0-af50-b45db5b07626 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-68d28ff8-3c33-4fa0-af50-b45db5b07626 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-68d28ff8-3c33-4fa0-af50-b45db5b07626 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-68d28ff8-3c33-4fa0-af50-b45db5b07626 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-68d28ff8-3c33-4fa0-af50-b45db5b07626 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-68d28ff8-3c33-4fa0-af50-b45db5b07626 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-68d28ff8-3c33-4fa0-af50-b45db5b07626 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-68d28ff8-3c33-4fa0-af50-b45db5b07626 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064166 Apr 14 02:08:22 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 328/977] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:08:22 2023] GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:08:22 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-9d31e043-558d-4df2-a863-ed86ef2f64c5 req-3accd0c5-1ddc-49b8-9961-899376895ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24db983d-4ad5-45be-a8e5-8448b3e5e065", "name": "network-vif-deleted", "tag": "9f06d104-c24c-4287-817c-9f05b53fbb29"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:08:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-9d31e043-558d-4df2-a863-ed86ef2f64c5 req-3accd0c5-1ddc-49b8-9961-899376895ae2 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-9d31e043-558d-4df2-a863-ed86ef2f64c5 req-3accd0c5-1ddc-49b8-9961-899376895ae2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-9d31e043-558d-4df2-a863-ed86ef2f64c5 req-3accd0c5-1ddc-49b8-9961-899376895ae2 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-9d31e043-558d-4df2-a863-ed86ef2f64c5 req-3accd0c5-1ddc-49b8-9961-899376895ae2 service nova] Creating event network-vif-deleted:9f06d104-c24c-4287-817c-9f05b53fbb29 for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 on user Apr 14 02:08:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-9d31e043-558d-4df2-a863-ed86ef2f64c5 req-3accd0c5-1ddc-49b8-9961-899376895ae2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030240 Apr 14 02:08:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 326/978] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:08:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:08:23 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:08:23 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:23 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:08:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" status: 204 len: 0 microversion: 2.1 time: 0.115149 Apr 14 02:08:23 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 325/979] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:08:23 2023] DELETE /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:08:23 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:08:23 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:23 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:08:23 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-7f93a48b-b701-4b47-8c35-5b2b644a4b90 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" status: 200 len: 1661 microversion: 2.1 time: 0.178235 Apr 14 02:08:23 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 329/980] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:08:23 2023] GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => generated 1661 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:08:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570", "tag": "735565d4-21ba-4824-9dcb-d464456080fc"}, {"server_uuid": "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570", "name": "network-vif-unplugged", "status": "completed", "tag": "735565d4-21ba-4824-9dcb-d464456080fc"}, {"server_uuid": "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570", "name": "network-vif-plugged", "status": "completed", "tag": "735565d4-21ba-4824-9dcb-d464456080fc"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:08:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Creating event network-changed:735565d4-21ba-4824-9dcb-d464456080fc for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 on user Apr 14 02:08:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Creating event network-vif-unplugged:735565d4-21ba-4824-9dcb-d464456080fc for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 on user Apr 14 02:08:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Creating event network-vif-plugged:735565d4-21ba-4824-9dcb-d464456080fc for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 on user Apr 14 02:08:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.032624 Apr 14 02:08:24 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 327/981] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:08:25 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449", "device": "/dev/vdb"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:08:25 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:25 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:25 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365323 Apr 14 02:08:25 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 326/982] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:08:24 2023] POST /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:08:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570", "name": "network-vif-deleted", "tag": "735565d4-21ba-4824-9dcb-d464456080fc"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:08:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] Creating event network-vif-deleted:735565d4-21ba-4824-9dcb-d464456080fc for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 on user Apr 14 02:08:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033114 Apr 14 02:08:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 330/983] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] HTTP exception thrown: Instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 could not be found. Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Request method failure captured: Apr 14 02:08:38 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21 HTTP/1.1 Apr 14 02:08:38 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:08:38 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:08:38 user devstack@n-api.service[61837]: Connection: close Apr 14 02:08:38 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:08:38 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:08:38 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:08:38 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:08:38 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLT8EFpOdW7TqkQilmmeleRzuj-3t7lsG6EZ3SuDh5EdHTFDtlXHN-1ICx3yHFfsn3opBNgvtWfXWlL_S45PvOaVmkLLl24R9NdccEfboyVde2oMSAiEZQTSX9jHX4Z09lIbSjVQicZf6ZVo1V8Kbw0aAIhbsHyhbrX1r0hCh5ElEYQ Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Project-Id: e7d826f5f9504efe95f0736f538951b4 Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Project-Name: tempest-VolumesActionsTest-1128976857 Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7d826f5f9504efe95f0736f538951b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e7d826f5f9504efe95f0736f538951b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7d826f5f9504efe95f0736f538951b4"}]}] Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Tenant: tempest-VolumesActionsTest-1128976857 Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Tenant-Id: e7d826f5f9504efe95f0736f538951b4 Apr 14 02:08:38 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-VolumesActionsTest-1128976857 Apr 14 02:08:38 user devstack@n-api.service[61837]: X-User: tempest-VolumesActionsTest-1128976857-project-member Apr 14 02:08:38 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:08:38 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:08:38 user devstack@n-api.service[61837]: X-User-Id: 97dc26d9782b4960af1ae5056a85616e Apr 14 02:08:38 user devstack@n-api.service[61837]: X-User-Name: tempest-VolumesActionsTest-1128976857-project-member Apr 14 02:08:38 user devstack@n-api.service[61837]: method: > Apr 14 02:08:38 user devstack@n-api.service[61837]: exception: Instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 could not be found. Apr 14 02:08:38 user devstack@n-api.service[61837]: action_args: {'id': 'bd1bf0f2-5c22-4c42-9e19-b22343997d21'} Apr 14 02:08:38 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 could not be found. Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 could not be found. Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 could not be found. Apr 14 02:08:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:08:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Returning 404 to user: Instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:08:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ce4e3610-aed4-4a17-b121-96d78b42c755 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21" status: 404 len: 111 microversion: 2.1 time: 0.036023 Apr 14 02:08:38 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 328/984] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:08:38 2023] GET /compute/v2.1/servers/bd1bf0f2-5c22-4c42-9e19-b22343997d21 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:47 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'services' on Instance uuid c63b62a9-626c-45ca-a454-4840f51bb28c {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:08:47 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c/os-volume_attachments/5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449" status: 202 len: 0 microversion: 2.1 time: 0.208681 Apr 14 02:08:47 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 327/985] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:08:47 2023] DELETE /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c/os-volume_attachments/5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=20 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:47 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:08:47 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c" status: 204 len: 0 microversion: 2.1 time: 0.299552 Apr 14 02:08:47 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 331/986] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:08:47 2023] DELETE /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:08:47 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:08:47 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:08:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:47 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:48 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb0e166c1f448cbba774b835f9798c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba8f38142a41928f0d2e8ead3aab96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:08:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b433305e-5e2c-47f3-9966-51f7105acb2d tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c" status: 200 len: 1545 microversion: 2.1 time: 0.164980 Apr 14 02:08:48 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 329/987] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:08:47 2023] GET /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c => generated 1545 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 02:08:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63b62a9-626c-45ca-a454-4840f51bb28c", "name": "network-vif-unplugged", "status": "completed", "tag": "92e48f25-5c12-4ff1-840d-54bee4da0ef2"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:08:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:49 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] Creating event network-vif-unplugged:92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance c63b62a9-626c-45ca-a454-4840f51bb28c on user Apr 14 02:08:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029393 Apr 14 02:08:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 328/988] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:08:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:08:51 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-0d0e43e0-1397-4f68-a5a0-aca4c34c29be req-3a71a187-6966-424a-a670-55ccec29b3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63b62a9-626c-45ca-a454-4840f51bb28c", "name": "network-vif-deleted", "tag": "92e48f25-5c12-4ff1-840d-54bee4da0ef2"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:08:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0d0e43e0-1397-4f68-a5a0-aca4c34c29be req-3a71a187-6966-424a-a670-55ccec29b3eb service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0d0e43e0-1397-4f68-a5a0-aca4c34c29be req-3a71a187-6966-424a-a670-55ccec29b3eb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-0d0e43e0-1397-4f68-a5a0-aca4c34c29be req-3a71a187-6966-424a-a670-55ccec29b3eb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-0d0e43e0-1397-4f68-a5a0-aca4c34c29be req-3a71a187-6966-424a-a670-55ccec29b3eb service nova] Creating event network-vif-deleted:92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance c63b62a9-626c-45ca-a454-4840f51bb28c on user Apr 14 02:08:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-0d0e43e0-1397-4f68-a5a0-aca4c34c29be req-3a71a187-6966-424a-a670-55ccec29b3eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033759 Apr 14 02:08:51 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 332/989] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:08:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:08:51 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63b62a9-626c-45ca-a454-4840f51bb28c", "name": "network-vif-plugged", "status": "completed", "tag": "92e48f25-5c12-4ff1-840d-54bee4da0ef2"}, {"server_uuid": "c63b62a9-626c-45ca-a454-4840f51bb28c", "name": "network-vif-plugged", "status": "completed", "tag": "92e48f25-5c12-4ff1-840d-54bee4da0ef2"}, {"server_uuid": "c63b62a9-626c-45ca-a454-4840f51bb28c", "name": "network-vif-plugged", "status": "completed", "tag": "92e48f25-5c12-4ff1-840d-54bee4da0ef2"}, {"server_uuid": "c63b62a9-626c-45ca-a454-4840f51bb28c", "name": "network-vif-plugged", "status": "completed", "tag": "92e48f25-5c12-4ff1-840d-54bee4da0ef2"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:08:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:08:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:08:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:08:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Creating event network-vif-plugged:92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance c63b62a9-626c-45ca-a454-4840f51bb28c on user Apr 14 02:08:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Creating event network-vif-plugged:92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance c63b62a9-626c-45ca-a454-4840f51bb28c on user Apr 14 02:08:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Creating event network-vif-plugged:92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance c63b62a9-626c-45ca-a454-4840f51bb28c on user Apr 14 02:08:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Creating event network-vif-plugged:92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance c63b62a9-626c-45ca-a454-4840f51bb28c on user Apr 14 02:08:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.029944 Apr 14 02:08:51 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 330/990] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:08:51 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HTTP exception thrown: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Request method failure captured: Apr 14 02:09:08 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 HTTP/1.1 Apr 14 02:09:08 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:09:08 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:09:08 user devstack@n-api.service[61835]: Connection: close Apr 14 02:09:08 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:09:08 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:09:08 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:09:08 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:09:08 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLAyAmjbZ4Ip4Yn_gzbn5tzy9loQSOvZJ19RfXr9RD273lL5zAY_k1-4eVimSbm9h6kyAWQI7EYGKXhfuMq7ANc67_B8gs-r2QFDmdkWH_TNu1qwT8WD-BfWZfCipAiP2SGrvJ368nutyt5JC02lxX6v70oTM6oHaHhBBksax4OchN8 Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Project-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}] Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Tenant: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Tenant-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:09:08 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:08 user devstack@n-api.service[61835]: X-User: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:09:08 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:09:08 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:09:08 user devstack@n-api.service[61835]: X-User-Id: 78ccd1a1ec1b486981d850881734fe02 Apr 14 02:09:08 user devstack@n-api.service[61835]: X-User-Name: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:09:08 user devstack@n-api.service[61835]: method: > Apr 14 02:09:08 user devstack@n-api.service[61835]: exception: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61835]: action_args: {'id': '24db983d-4ad5-45be-a8e5-8448b3e5e065'} Apr 14 02:09:08 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Returning 404 to user: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:09:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-aaf8c8a0-dbae-4e42-bbd7-e34f63bf1a1c tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 404 len: 111 microversion: 2.1 time: 0.048153 Apr 14 02:09:08 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 329/991] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:09:08 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HTTP exception thrown: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Request method failure captured: Apr 14 02:09:08 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 HTTP/1.1 Apr 14 02:09:08 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:09:08 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:09:08 user devstack@n-api.service[61836]: Connection: close Apr 14 02:09:08 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:09:08 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:09:08 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:09:08 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:09:08 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLAyAmjbZ4Ip4Yn_gzbn5tzy9loQSOvZJ19RfXr9RD273lL5zAY_k1-4eVimSbm9h6kyAWQI7EYGKXhfuMq7ANc67_B8gs-r2QFDmdkWH_TNu1qwT8WD-BfWZfCipAiP2SGrvJ368nutyt5JC02lxX6v70oTM6oHaHhBBksax4OchN8 Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Project-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Project-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}] Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Tenant: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Tenant-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:09:08 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:08 user devstack@n-api.service[61836]: X-User: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:09:08 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:09:08 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:09:08 user devstack@n-api.service[61836]: X-User-Id: 78ccd1a1ec1b486981d850881734fe02 Apr 14 02:09:08 user devstack@n-api.service[61836]: X-User-Name: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:09:08 user devstack@n-api.service[61836]: method: > Apr 14 02:09:08 user devstack@n-api.service[61836]: exception: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61836]: action_args: {'id': '24db983d-4ad5-45be-a8e5-8448b3e5e065'} Apr 14 02:09:08 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Returning 404 to user: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:09:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-56dd65d4-663c-49d7-a3d6-c7c9ea62513a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 404 len: 111 microversion: 2.1 time: 0.039337 Apr 14 02:09:08 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 333/992] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:09:08 2023] DELETE /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=10 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HTTP exception thrown: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Request method failure captured: Apr 14 02:09:08 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 HTTP/1.1 Apr 14 02:09:08 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:09:08 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:09:08 user devstack@n-api.service[61837]: Connection: close Apr 14 02:09:08 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:09:08 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:09:08 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:09:08 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:09:08 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLAyAmjbZ4Ip4Yn_gzbn5tzy9loQSOvZJ19RfXr9RD273lL5zAY_k1-4eVimSbm9h6kyAWQI7EYGKXhfuMq7ANc67_B8gs-r2QFDmdkWH_TNu1qwT8WD-BfWZfCipAiP2SGrvJ368nutyt5JC02lxX6v70oTM6oHaHhBBksax4OchN8 Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Project-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Project-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}] Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Tenant: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Tenant-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:09:08 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:08 user devstack@n-api.service[61837]: X-User: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:09:08 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:09:08 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:09:08 user devstack@n-api.service[61837]: X-User-Id: 78ccd1a1ec1b486981d850881734fe02 Apr 14 02:09:08 user devstack@n-api.service[61837]: X-User-Name: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:09:08 user devstack@n-api.service[61837]: method: > Apr 14 02:09:08 user devstack@n-api.service[61837]: exception: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61837]: action_args: {'id': '24db983d-4ad5-45be-a8e5-8448b3e5e065'} Apr 14 02:09:08 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. Apr 14 02:09:08 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Returning 404 to user: Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:09:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f6debceb-1c2f-442a-965b-7e8b8b97d1a7 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065" status: 404 len: 111 microversion: 2.1 time: 0.033022 Apr 14 02:09:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 331/993] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:09:08 2023] GET /compute/v2.1/servers/24db983d-4ad5-45be-a8e5-8448b3e5e065 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:09:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06" status: 204 len: 0 microversion: 2.1 time: 0.113152 Apr 14 02:09:08 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 330/994] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:09:08 2023] DELETE /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:09 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:09:09 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-294bfbba-8613-4c03-aeba-a242a26d9050 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06" status: 200 len: 1545 microversion: 2.1 time: 0.169340 Apr 14 02:09:09 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 334/995] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:09:08 2023] GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06 => generated 1545 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:09:09 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba29111-1e9b-4947-b046-6bbe888eca06", "name": "network-vif-unplugged", "status": "completed", "tag": "5b8a0a31-9ecf-4b31-a458-778005d846f4"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] Creating event network-vif-unplugged:5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance 5ba29111-1e9b-4947-b046-6bbe888eca06 on user Apr 14 02:09:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037755 Apr 14 02:09:09 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 332/996] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:09:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba29111-1e9b-4947-b046-6bbe888eca06", "name": "network-vif-plugged", "status": "completed", "tag": "5b8a0a31-9ecf-4b31-a458-778005d846f4"}, {"server_uuid": "5ba29111-1e9b-4947-b046-6bbe888eca06", "name": "network-vif-deleted", "tag": "5b8a0a31-9ecf-4b31-a458-778005d846f4"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] Creating event network-vif-plugged:5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance 5ba29111-1e9b-4947-b046-6bbe888eca06 on user Apr 14 02:09:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] Creating event network-vif-deleted:5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance 5ba29111-1e9b-4947-b046-6bbe888eca06 on user Apr 14 02:09:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040336 Apr 14 02:09:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 331/997] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:13 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] HTTP exception thrown: Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 could not be found. Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Request method failure captured: Apr 14 02:09:13 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 HTTP/1.1 Apr 14 02:09:13 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:09:13 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:09:13 user devstack@n-api.service[61836]: Connection: close Apr 14 02:09:13 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:09:13 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:09:13 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:09:13 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:09:13 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLQnnWsmUs-4VtQyHvEbwK-JBn4O2FWafQ345QO-mje_VK17zI3J_nIr-ogQPityK910QmZ-RWc2KmgX3SJ2AoxyzGBCEUbjikcltLiGmKNR7cMCsz84KlfW63jyC_ekZGnd5zxPauKGbb6YoN3848WZ2mkexmzRUUCd7CiyZm_1C4Q Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Project-Id: 27dc405e16434633956ed2cd7e1791cd Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Project-Name: tempest-TestStampPattern-190654074 Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27dc405e16434633956ed2cd7e1791cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27dc405e16434633956ed2cd7e1791cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27dc405e16434633956ed2cd7e1791cd"}]}] Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Tenant: tempest-TestStampPattern-190654074 Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Tenant-Id: 27dc405e16434633956ed2cd7e1791cd Apr 14 02:09:13 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-TestStampPattern-190654074 Apr 14 02:09:13 user devstack@n-api.service[61836]: X-User: tempest-TestStampPattern-190654074-project-member Apr 14 02:09:13 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:09:13 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:09:13 user devstack@n-api.service[61836]: X-User-Id: 7ae5170969344b9fa5294231f8ffbe72 Apr 14 02:09:13 user devstack@n-api.service[61836]: X-User-Name: tempest-TestStampPattern-190654074-project-member Apr 14 02:09:13 user devstack@n-api.service[61836]: method: > Apr 14 02:09:13 user devstack@n-api.service[61836]: exception: Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 could not be found. Apr 14 02:09:13 user devstack@n-api.service[61836]: action_args: {'id': '2bf92b68-9cc4-4e22-b7b8-30eb6b69c570'} Apr 14 02:09:13 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 could not be found. Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 could not be found. Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 could not be found. Apr 14 02:09:13 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:09:13 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Returning 404 to user: Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:09:13 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4be74c32-179c-4be5-9fa0-826baa7f38fa tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" status: 404 len: 111 microversion: 2.1 time: 0.028734 Apr 14 02:09:13 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 335/998] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:09:13 2023] GET /compute/v2.1/servers/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] HTTP exception thrown: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a is not attached to volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Request method failure captured: Apr 14 02:09:19 user devstack@n-api.service[61837]: request: DELETE /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments/d6e664bf-00ef-4bb1-835c-e96535d4bb32 HTTP/1.1 Apr 14 02:09:19 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:09:19 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:09:19 user devstack@n-api.service[61837]: Connection: close Apr 14 02:09:19 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:09:19 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:09:19 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:09:19 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:09:19 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLQnnWsmUs-4VtQyHvEbwK-JBn4O2FWafQ345QO-mje_VK17zI3J_nIr-ogQPityK910QmZ-RWc2KmgX3SJ2AoxyzGBCEUbjikcltLiGmKNR7cMCsz84KlfW63jyC_ekZGnd5zxPauKGbb6YoN3848WZ2mkexmzRUUCd7CiyZm_1C4Q Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Project-Id: 27dc405e16434633956ed2cd7e1791cd Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestStampPattern-190654074 Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27dc405e16434633956ed2cd7e1791cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27dc405e16434633956ed2cd7e1791cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27dc405e16434633956ed2cd7e1791cd"}]}] Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Tenant: tempest-TestStampPattern-190654074 Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Tenant-Id: 27dc405e16434633956ed2cd7e1791cd Apr 14 02:09:19 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestStampPattern-190654074 Apr 14 02:09:19 user devstack@n-api.service[61837]: X-User: tempest-TestStampPattern-190654074-project-member Apr 14 02:09:19 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:09:19 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:09:19 user devstack@n-api.service[61837]: X-User-Id: 7ae5170969344b9fa5294231f8ffbe72 Apr 14 02:09:19 user devstack@n-api.service[61837]: X-User-Name: tempest-TestStampPattern-190654074-project-member Apr 14 02:09:19 user devstack@n-api.service[61837]: method: > Apr 14 02:09:19 user devstack@n-api.service[61837]: exception: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a is not attached to volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 Apr 14 02:09:19 user devstack@n-api.service[61837]: action_args: {'server_id': '57b15ad5-341a-47f8-9e3e-5cec8a85098a', 'id': 'd6e664bf-00ef-4bb1-835c-e96535d4bb32'} Apr 14 02:09:19 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d6e664bf-00ef-4bb1-835c-e96535d4bb32. Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a is not attached to volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a is not attached to volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 Apr 14 02:09:19 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Returning 404 to user: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a is not attached to volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:09:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-e90a1b1a-f27c-4c40-85a8-be0e643ed657 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments/d6e664bf-00ef-4bb1-835c-e96535d4bb32" status: 404 len: 154 microversion: 2.1 time: 0.106127 Apr 14 02:09:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 333/999] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:09:19 2023] DELETE /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a/os-volume_attachments/d6e664bf-00ef-4bb1-835c-e96535d4bb32 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:09:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a" status: 204 len: 0 microversion: 2.1 time: 0.122547 Apr 14 02:09:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 332/1000] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:09:20 2023] DELETE /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:09:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:20 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b15ad5-341a-47f8-9e3e-5cec8a85098a", "tag": "18eed24e-8acb-457c-95b8-64c141faa4aa"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] Creating event network-changed:18eed24e-8acb-457c-95b8-64c141faa4aa for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a on user Apr 14 02:09:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225762 Apr 14 02:09:20 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 336/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:09:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:20 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:09:20 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-893b5f1d-a716-4949-8329-148a4dcc4537 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a" status: 200 len: 1659 microversion: 2.1 time: 0.306454 Apr 14 02:09:20 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 334/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:09:20 2023] GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a => generated 1659 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b15ad5-341a-47f8-9e3e-5cec8a85098a", "name": "network-vif-unplugged", "status": "completed", "tag": "18eed24e-8acb-457c-95b8-64c141faa4aa"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] Creating event network-vif-unplugged:18eed24e-8acb-457c-95b8-64c141faa4aa for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a on user Apr 14 02:09:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029169 Apr 14 02:09:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 333/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:09:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:22 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b15ad5-341a-47f8-9e3e-5cec8a85098a", "name": "network-vif-plugged", "status": "completed", "tag": "18eed24e-8acb-457c-95b8-64c141faa4aa"}, {"server_uuid": "57b15ad5-341a-47f8-9e3e-5cec8a85098a", "name": "network-vif-deleted", "tag": "18eed24e-8acb-457c-95b8-64c141faa4aa"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] Creating event network-vif-plugged:18eed24e-8acb-457c-95b8-64c141faa4aa for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a on user Apr 14 02:09:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] Creating event network-vif-deleted:18eed24e-8acb-457c-95b8-64c141faa4aa for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a on user Apr 14 02:09:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032963 Apr 14 02:09:22 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 337/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:09:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2bbad7d4-c255-4e4a-96b7-25a0229eec56 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'create', calling method: .version_select at 0x7fd4211360e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1668215586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtEzsPoBbdFHW/OauW1N2nA3eHApzo9P+avktVZiY+BDznrsT5FrpFSwKh0+oQn87dy12kX9i8d8dwF2rJqPbbOiawNN4AoRze6n/YxMVSWae21mhWOZtM+ldYOp4zong=="}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:27 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-2bbad7d4-c255-4e4a-96b7-25a0229eec56 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting quotas for project 20723e8ba2f5480b8c17e6c4fc8fff9f. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:09:27 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-2bbad7d4-c255-4e4a-96b7-25a0229eec56 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting quotas for user 19633f8d769c4e50b5e6c9a75497b510 and project 20723e8ba2f5480b8c17e6c4fc8fff9f. Resources: {'key_pairs'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:09:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-2bbad7d4-c255-4e4a-96b7-25a0229eec56 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051263 Apr 14 02:09:27 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 335/1005] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:09:27 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-435405212", "imageRef": "b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1668215586", "networks": [{"uuid": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b"}]}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.network.neutron [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] validate_networks() for [('6a2a0716-97e3-42a7-bdf8-5f5548cf550b', None, None, None, None, None)] {{(pid=61835) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image limits 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image pref 0:0:0 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61835) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting quotas for project 20723e8ba2f5480b8c17e6c4fc8fff9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting quotas for user 19633f8d769c4e50b5e6c9a75497b510 and project 20723e8ba2f5480b8c17e6c4fc8fff9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Going to run 1 instances... {{(pid=61835) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:09:27 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61835) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:09:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.660405 Apr 14 02:09:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 334/1006] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:09:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:09:27 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-76903f92-f83e-45b9-8cc0-4a64c415f0ea tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:27 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-76903f92-f83e-45b9-8cc0-4a64c415f0ea tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:27 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-76903f92-f83e-45b9-8cc0-4a64c415f0ea tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:09:27 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-76903f92-f83e-45b9-8cc0-4a64c415f0ea tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 200 len: 1252 microversion: 2.1 time: 0.072800 Apr 14 02:09:27 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 338/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:09:27 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 1252 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:09:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] Creating event network-changed:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:09:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030698 Apr 14 02:09:30 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 336/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:09:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:32 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:32 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:32 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] Creating event network-vif-plugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:09:32 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046352 Apr 14 02:09:32 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 335/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:09:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:34 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:09:34 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=14 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:34 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:34 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] Creating event network-vif-plugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:09:34 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032232 Apr 14 02:09:34 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 339/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:09:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] HTTP exception thrown: Instance c63b62a9-626c-45ca-a454-4840f51bb28c could not be found. Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Request method failure captured: Apr 14 02:09:38 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c HTTP/1.1 Apr 14 02:09:38 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:09:38 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:09:38 user devstack@n-api.service[61837]: Connection: close Apr 14 02:09:38 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:09:38 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:09:38 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:09:38 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:09:38 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLRcMU-ngZDNCTKDelVjBvSv9TOakXfOi99Gb2LAV5mbURPH2KnbE-nHkg_C1h6CBABXpx-JF6kMOoTjyt-MBEbabMJuOzDzF1B8SdBRMfcJC8B4FL8V8HowMGmK1ry1Ifb2O6zwxa1WmZ_JPVWUSrokhlxM2Nsd_J2v7yZwoS26mfY Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Project-Id: 3fba8f38142a41928f0d2e8ead3aab96 Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2121749885 Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fba8f38142a41928f0d2e8ead3aab96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3fba8f38142a41928f0d2e8ead3aab96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fba8f38142a41928f0d2e8ead3aab96"}]}] Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Tenant: tempest-VolumesSnapshotTestJSON-2121749885 Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Tenant-Id: 3fba8f38142a41928f0d2e8ead3aab96 Apr 14 02:09:38 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2121749885 Apr 14 02:09:38 user devstack@n-api.service[61837]: X-User: tempest-VolumesSnapshotTestJSON-2121749885-project-member Apr 14 02:09:38 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:09:38 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:09:38 user devstack@n-api.service[61837]: X-User-Id: fbb0e166c1f448cbba774b835f9798c9 Apr 14 02:09:38 user devstack@n-api.service[61837]: X-User-Name: tempest-VolumesSnapshotTestJSON-2121749885-project-member Apr 14 02:09:38 user devstack@n-api.service[61837]: method: > Apr 14 02:09:38 user devstack@n-api.service[61837]: exception: Instance c63b62a9-626c-45ca-a454-4840f51bb28c could not be found. Apr 14 02:09:38 user devstack@n-api.service[61837]: action_args: {'id': 'c63b62a9-626c-45ca-a454-4840f51bb28c'} Apr 14 02:09:38 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63b62a9-626c-45ca-a454-4840f51bb28c could not be found. Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63b62a9-626c-45ca-a454-4840f51bb28c could not be found. Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63b62a9-626c-45ca-a454-4840f51bb28c could not be found. Apr 14 02:09:38 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:09:38 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Returning 404 to user: Instance c63b62a9-626c-45ca-a454-4840f51bb28c could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:09:38 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-02fd9216-bd88-41a8-9112-03c2150f97ee tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c" status: 404 len: 111 microversion: 2.1 time: 0.034122 Apr 14 02:09:38 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 337/1011] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:09:38 2023] GET /compute/v2.1/servers/c63b62a9-626c-45ca-a454-4840f51bb28c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:09:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HTTP exception thrown: Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 could not be found. Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Request method failure captured: Apr 14 02:09:59 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06 HTTP/1.1 Apr 14 02:09:59 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:09:59 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:09:59 user devstack@n-api.service[61835]: Connection: close Apr 14 02:09:59 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:09:59 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:09:59 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:09:59 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:09:59 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLAyAmjbZ4Ip4Yn_gzbn5tzy9loQSOvZJ19RfXr9RD273lL5zAY_k1-4eVimSbm9h6kyAWQI7EYGKXhfuMq7ANc67_B8gs-r2QFDmdkWH_TNu1qwT8WD-BfWZfCipAiP2SGrvJ368nutyt5JC02lxX6v70oTM6oHaHhBBksax4OchN8 Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Project-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Project-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}] Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Tenant: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Tenant-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:09:59 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:09:59 user devstack@n-api.service[61835]: X-User: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:09:59 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:09:59 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:09:59 user devstack@n-api.service[61835]: X-User-Id: 78ccd1a1ec1b486981d850881734fe02 Apr 14 02:09:59 user devstack@n-api.service[61835]: X-User-Name: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:09:59 user devstack@n-api.service[61835]: method: > Apr 14 02:09:59 user devstack@n-api.service[61835]: exception: Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 could not be found. Apr 14 02:09:59 user devstack@n-api.service[61835]: action_args: {'id': '5ba29111-1e9b-4947-b046-6bbe888eca06'} Apr 14 02:09:59 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 could not be found. Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 could not be found. Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 could not be found. Apr 14 02:09:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:09:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Returning 404 to user: Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:09:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-696d51f9-40b7-4558-a421-d0a6364d5a09 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06" status: 404 len: 111 microversion: 2.1 time: 0.053804 Apr 14 02:09:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 336/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:09:59 2023] GET /compute/v2.1/servers/5ba29111-1e9b-4947-b046-6bbe888eca06 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=16 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HTTP exception thrown: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Request method failure captured: Apr 14 02:10:05 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 HTTP/1.1 Apr 14 02:10:05 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:10:05 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:10:05 user devstack@n-api.service[61836]: Connection: close Apr 14 02:10:05 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:10:05 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:10:05 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:10:05 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:10:05 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLAyAmjbZ4Ip4Yn_gzbn5tzy9loQSOvZJ19RfXr9RD273lL5zAY_k1-4eVimSbm9h6kyAWQI7EYGKXhfuMq7ANc67_B8gs-r2QFDmdkWH_TNu1qwT8WD-BfWZfCipAiP2SGrvJ368nutyt5JC02lxX6v70oTM6oHaHhBBksax4OchN8 Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Project-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Project-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}] Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Tenant: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Tenant-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:10:05 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:10:05 user devstack@n-api.service[61836]: X-User: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:10:05 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:10:05 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:10:05 user devstack@n-api.service[61836]: X-User-Id: 78ccd1a1ec1b486981d850881734fe02 Apr 14 02:10:05 user devstack@n-api.service[61836]: X-User-Name: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:10:05 user devstack@n-api.service[61836]: method: > Apr 14 02:10:05 user devstack@n-api.service[61836]: exception: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61836]: action_args: {'id': '73cc8ede-babd-4281-bf1d-c5a3f8bad440'} Apr 14 02:10:05 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Returning 404 to user: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:10:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-5e36767c-443c-482b-bff9-dd10e3863cf2 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 404 len: 111 microversion: 2.1 time: 0.043722 Apr 14 02:10:05 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 340/1013] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:10:05 2023] DELETE /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=16 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HTTP exception thrown: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Request method failure captured: Apr 14 02:10:05 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 HTTP/1.1 Apr 14 02:10:05 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:10:05 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:10:05 user devstack@n-api.service[61837]: Connection: close Apr 14 02:10:05 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:10:05 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:10:05 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:10:05 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:10:05 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLAyAmjbZ4Ip4Yn_gzbn5tzy9loQSOvZJ19RfXr9RD273lL5zAY_k1-4eVimSbm9h6kyAWQI7EYGKXhfuMq7ANc67_B8gs-r2QFDmdkWH_TNu1qwT8WD-BfWZfCipAiP2SGrvJ368nutyt5JC02lxX6v70oTM6oHaHhBBksax4OchN8 Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Project-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Project-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2ed4ed4ab2fd4c14b3e2afe343fd7256"}]}] Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Tenant: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Tenant-Id: 2ed4ed4ab2fd4c14b3e2afe343fd7256 Apr 14 02:10:05 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-ServerActionsTestJSON-2035821517 Apr 14 02:10:05 user devstack@n-api.service[61837]: X-User: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:10:05 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:10:05 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:10:05 user devstack@n-api.service[61837]: X-User-Id: 78ccd1a1ec1b486981d850881734fe02 Apr 14 02:10:05 user devstack@n-api.service[61837]: X-User-Name: tempest-ServerActionsTestJSON-2035821517-project-member Apr 14 02:10:05 user devstack@n-api.service[61837]: method: > Apr 14 02:10:05 user devstack@n-api.service[61837]: exception: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61837]: action_args: {'id': '73cc8ede-babd-4281-bf1d-c5a3f8bad440'} Apr 14 02:10:05 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. Apr 14 02:10:05 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:10:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Returning 404 to user: Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:10:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-74cd670a-afeb-4025-a307-04b742cb8fe5 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440" status: 404 len: 111 microversion: 2.1 time: 0.040629 Apr 14 02:10:05 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 338/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:10:05 2023] GET /compute/v2.1/servers/73cc8ede-babd-4281-bf1d-c5a3f8bad440 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 02:10:05 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-1a122154-c38b-4902-87fa-1cfdaef8564d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Calling method '.version_select at 0x7fd42041a290>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:10:05 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-1a122154-c38b-4902-87fa-1cfdaef8564d tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165395776" status: 202 len: 0 microversion: 2.1 time: 0.024289 Apr 14 02:10:05 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 337/1015] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 02:10:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165395776 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] HTTP exception thrown: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a could not be found. Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Request method failure captured: Apr 14 02:10:10 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a HTTP/1.1 Apr 14 02:10:10 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:10:10 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:10:10 user devstack@n-api.service[61836]: Connection: close Apr 14 02:10:10 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:10:10 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:10:10 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:10:10 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:10:10 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLQnnWsmUs-4VtQyHvEbwK-JBn4O2FWafQ345QO-mje_VK17zI3J_nIr-ogQPityK910QmZ-RWc2KmgX3SJ2AoxyzGBCEUbjikcltLiGmKNR7cMCsz84KlfW63jyC_ekZGnd5zxPauKGbb6YoN3848WZ2mkexmzRUUCd7CiyZm_1C4Q Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Project-Id: 27dc405e16434633956ed2cd7e1791cd Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Project-Name: tempest-TestStampPattern-190654074 Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27dc405e16434633956ed2cd7e1791cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27dc405e16434633956ed2cd7e1791cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27dc405e16434633956ed2cd7e1791cd"}]}] Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Tenant: tempest-TestStampPattern-190654074 Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Tenant-Id: 27dc405e16434633956ed2cd7e1791cd Apr 14 02:10:10 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-TestStampPattern-190654074 Apr 14 02:10:10 user devstack@n-api.service[61836]: X-User: tempest-TestStampPattern-190654074-project-member Apr 14 02:10:10 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:10:10 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:10:10 user devstack@n-api.service[61836]: X-User-Id: 7ae5170969344b9fa5294231f8ffbe72 Apr 14 02:10:10 user devstack@n-api.service[61836]: X-User-Name: tempest-TestStampPattern-190654074-project-member Apr 14 02:10:10 user devstack@n-api.service[61836]: method: > Apr 14 02:10:10 user devstack@n-api.service[61836]: exception: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a could not be found. Apr 14 02:10:10 user devstack@n-api.service[61836]: action_args: {'id': '57b15ad5-341a-47f8-9e3e-5cec8a85098a'} Apr 14 02:10:10 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a could not be found. Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a could not be found. Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a could not be found. Apr 14 02:10:10 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:10:10 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Returning 404 to user: Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:10:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-a669351a-7b21-419d-b596-6c0c8080e517 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a" status: 404 len: 111 microversion: 2.1 time: 0.031137 Apr 14 02:10:10 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 341/1016] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:10:10 2023] GET /compute/v2.1/servers/57b15ad5-341a-47f8-9e3e-5cec8a85098a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:10:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-b5dc88e6-e4fb-41fc-b7d8-d2bfc7516ec2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Calling method '.version_select at 0x7fd4210b2d40>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:10:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-b5dc88e6-e4fb-41fc-b7d8-d2bfc7516ec2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-610075453" status: 202 len: 0 microversion: 2.1 time: 0.023879 Apr 14 02:10:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 339/1017] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 02:10:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-610075453 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:10:17 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:17 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-8b9bb60c-73d3-4e21-a0b0-4c01ef85ac19 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: .version_select at 0x7fd420ea25f0>, body: {"keypair": {"name": "tempest-keypair-867176451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV4Y4FLi2GXegSJpwzJ9Ks60PPN72JDpmIKogBiE9qPz09L2D+DrHUUiWU4bmSP6spYC9uqMNwovh5BE5nQXgHNE0RBRiSaKwEcuLeVhSC3e8O/srH8F+vT0QL+25dXIg=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:10:17 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-8b9bb60c-73d3-4e21-a0b0-4c01ef85ac19 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:10:17 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-8b9bb60c-73d3-4e21-a0b0-4c01ef85ac19 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for user 168a0142cf984aacb1f087adcaa96468 and project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:10:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-8b9bb60c-73d3-4e21-a0b0-4c01ef85ac19 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157714 Apr 14 02:10:17 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 338/1018] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:10:17 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:10:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:10:17 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:10:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:17 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:18 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:10:18 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-35566ae0-5aeb-4a4a-a2e3-ac345db73b52 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 200 len: 1535 microversion: 2.1 time: 0.278029 Apr 14 02:10:18 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 342/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:10:17 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 1535 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1446254601", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "981c880a-2147-4da6-8021-a03d0aee3f3d"}], "security_groups": [{"name": "tempest-securitygroup--508310923"}], "key_name": "tempest-keypair-867176451", "user_data": "}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] validate_networks() for [('981c880a-2147-4da6-8021-a03d0aee3f3d', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for user 168a0142cf984aacb1f087adcaa96468 and project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:10:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:10:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.584366 Apr 14 02:10:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 340/1020] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:10:19 2023] POST /compute/v2.1/servers => generated 399 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 02:10:19 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-6a24cd82-b48b-4a42-a008-337382bac68d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:10:19 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-6a24cd82-b48b-4a42-a008-337382bac68d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:10:19 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-6a24cd82-b48b-4a42-a008-337382bac68d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:10:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-6a24cd82-b48b-4a42-a008-337382bac68d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007" status: 200 len: 1235 microversion: 2.1 time: 0.082869 Apr 14 02:10:19 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 339/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:10:19 2023] GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 => generated 1235 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 02:10:22 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ac5dda-cff9-4da5-a19d-49b74491f007", "tag": "38b47774-08a0-4e14-a236-fcab2f3bdb06"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:10:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:22 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] Creating event network-changed:38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance 21ac5dda-cff9-4da5-a19d-49b74491f007 on user Apr 14 02:10:22 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034523 Apr 14 02:10:22 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 343/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:10:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ac5dda-cff9-4da5-a19d-49b74491f007", "name": "network-vif-plugged", "status": "completed", "tag": "38b47774-08a0-4e14-a236-fcab2f3bdb06"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:10:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] Creating event network-vif-plugged:38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance 21ac5dda-cff9-4da5-a19d-49b74491f007 on user Apr 14 02:10:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048893 Apr 14 02:10:24 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 341/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:10:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:10:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ac5dda-cff9-4da5-a19d-49b74491f007", "name": "network-vif-plugged", "status": "completed", "tag": "38b47774-08a0-4e14-a236-fcab2f3bdb06"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:10:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:10:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:10:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:10:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] Creating event network-vif-plugged:38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance 21ac5dda-cff9-4da5-a19d-49b74491f007 on user Apr 14 02:10:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037959 Apr 14 02:10:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 340/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:10:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:11:09 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:09 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=12 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:09 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:11:09 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:11:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:10 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:10 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:11:10 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-effd0967-2152-4a37-b301-4d56d67fd694 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007" status: 200 len: 1544 microversion: 2.1 time: 0.369126 Apr 14 02:11:10 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 344/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:11:09 2023] GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 => generated 1544 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:18 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:11:18 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-130ede7d-69d8-4f9d-9618-13a9ef386a0c tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 200 len: 1535 microversion: 2.1 time: 0.216395 Apr 14 02:11:18 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 342/1026] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:11:18 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 1535 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Searching by: {'deleted': False, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f'} {{(pid=61835) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:18 user devstack@n-api.service[61835]: DEBUG nova.compute.multi_cell_list [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61835) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 02:11:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-9c5c3cdf-6da9-47f7-9e98-121988b41823 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.481462 Apr 14 02:11:19 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 341/1027] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 02:11:18 2023] GET /compute/v2.1/servers => generated 340 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:11:19 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:11:19 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:11:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:19 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:19 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:11:19 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4d216a3f-c69c-432c-8995-e6fab678ded7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 200 len: 1535 microversion: 2.1 time: 0.154020 Apr 14 02:11:19 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 345/1028] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:11:19 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 1535 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:11:21 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f12b47d-8b55-4650-9f88-e50281b67877"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:11:21 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:11:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:21 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300422 Apr 14 02:11:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 343/1029] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:11:21 2023] POST /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:11:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:11:30 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:11:30 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:30 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:30 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:31 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:11:31 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d57d7f26-af7f-4882-9429-6ec27e4c4904 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 200 len: 1581 microversion: 2.1 time: 0.193716 Apr 14 02:11:31 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 342/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:11:30 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 1581 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:11:32 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:11:32 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:32 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=12 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:32 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] Creating event network-changed:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:11:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058115 Apr 14 02:11:32 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 346/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:11:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1580253036"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:34 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:35 user devstack@n-api.service[61837]: INFO nova.network.security_group_api [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Adding security group 1bc218d2-8354-432b-856e-fd5daaf462e6 to port e204d7f5-314e-43ce-8772-e2f288f1858f Apr 14 02:11:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-1f92d8d9-4bd9-424a-b1b0-08aa3af45f86 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.533092 Apr 14 02:11:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 344/1032] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:11:34 2023] POST /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:11:35 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:11:35 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:11:35 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:11:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:35 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:35 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] Creating event network-changed:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:11:35 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031916 Apr 14 02:11:35 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 343/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:11:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:11:35 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:11:35 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4cb83a59-f3e6-4642-8679-d7391f5bffef tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 200 len: 1746 microversion: 2.1 time: 0.166579 Apr 14 02:11:35 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 347/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:11:35 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:11:37 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:11:37 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:11:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:37 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:37 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.090335 Apr 14 02:11:37 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 345/1035] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:11:37 2023] POST /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:11:37 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:11:37 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:11:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:38 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:11:38 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-e92294ec-889e-44d4-8617-ae6415cd3f8f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 200 len: 1748 microversion: 2.1 time: 0.250262 Apr 14 02:11:38 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 344/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:11:37 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 1748 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:11:38 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-unplugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:11:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:38 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] Creating event network-vif-unplugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:11:38 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030274 Apr 14 02:11:38 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 348/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:11:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:11:41 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:11:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] Creating event network-vif-plugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:11:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187240 Apr 14 02:11:41 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 346/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:11:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:11:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:11:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] Creating event network-vif-plugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:11:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093020 Apr 14 02:11:43 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 345/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:11:45 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:11:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:11:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:11:45 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:11:45 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] Creating event network-vif-plugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:11:45 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028471 Apr 14 02:11:45 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 349/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:11:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ad9da78b-c355-4ce6-b22f-322ace963715 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ad9da78b-c355-4ce6-b22f-322ace963715 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ad9da78b-c355-4ce6-b22f-322ace963715 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ad9da78b-c355-4ce6-b22f-322ace963715 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ad9da78b-c355-4ce6-b22f-322ace963715 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ad9da78b-c355-4ce6-b22f-322ace963715 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ad9da78b-c355-4ce6-b22f-322ace963715 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:10 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-ad9da78b-c355-4ce6-b22f-322ace963715 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:10 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ad9da78b-c355-4ce6-b22f-322ace963715 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098065 Apr 14 02:12:10 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 347/1041] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 02:12:10 2023] GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-interface => generated 282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:12:11 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:11 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=16 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ac5dda-cff9-4da5-a19d-49b74491f007", "tag": "38b47774-08a0-4e14-a236-fcab2f3bdb06"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:12:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] Creating event network-changed:38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance 21ac5dda-cff9-4da5-a19d-49b74491f007 on user Apr 14 02:12:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039365 Apr 14 02:12:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 346/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:12:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=12 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-be71c14e-5965-433d-b377-d1b9058aea5b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-be71c14e-5965-433d-b377-d1b9058aea5b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-be71c14e-5965-433d-b377-d1b9058aea5b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-be71c14e-5965-433d-b377-d1b9058aea5b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-be71c14e-5965-433d-b377-d1b9058aea5b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-be71c14e-5965-433d-b377-d1b9058aea5b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-be71c14e-5965-433d-b377-d1b9058aea5b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:11 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-be71c14e-5965-433d-b377-d1b9058aea5b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:11 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-be71c14e-5965-433d-b377-d1b9058aea5b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/ips" status: 200 len: 108 microversion: 2.1 time: 0.040828 Apr 14 02:12:11 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 350/1043] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:12:11 2023] GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/ips => generated 108 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:12:13 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "061ecf8a-30b1-466a-8a33-59b6281720bf"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:12:13 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:12:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:13 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267591 Apr 14 02:12:14 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 348/1044] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:12:13 2023] POST /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:12:21 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:21 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:21 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-94c1fc7b-7706-4940-b2f7-be3d25cf880b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: .version_select at 0x7fd4210bb2e0>, body: {"keypair": {"name": "tempest-keypair-1199811974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ4+1NCGI4tO0qfZ3R3Yoir5lSAMAMYO7EvxVjFGyu7gkgkkS/5jPuiDpqaoGxpbJiQZ2rscS94x5JCsuyDgjwaj4zCFezyKrr0EYSh2AlxgB2Zs09bnBWxE8HV+moyjw=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:12:21 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-94c1fc7b-7706-4940-b2f7-be3d25cf880b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:12:21 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-94c1fc7b-7706-4940-b2f7-be3d25cf880b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for user 168a0142cf984aacb1f087adcaa96468 and project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:12:21 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-94c1fc7b-7706-4940-b2f7-be3d25cf880b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056963 Apr 14 02:12:21 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 347/1045] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:12:21 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:12:23 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1112547716", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "981c880a-2147-4da6-8021-a03d0aee3f3d"}], "security_groups": [{"name": "tempest-securitygroup--172654104"}], "key_name": "tempest-keypair-1199811974", "user_data": "}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:12:23 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:23 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:23 user devstack@n-api.service[61836]: DEBUG nova.network.neutron [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] validate_networks() for [('981c880a-2147-4da6-8021-a03d0aee3f3d', None, None, None, None, None)] {{(pid=61836) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image limits 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image pref 0:0:0 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG nova.quota [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for user 168a0142cf984aacb1f087adcaa96468 and project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'ram', 'cores', 'instances'} {{(pid=61836) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Going to run 1 instances... {{(pid=61836) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:12:24 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:12:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.623367 Apr 14 02:12:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 351/1046] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:12:23 2023] POST /compute/v2.1/servers => generated 399 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:12:24 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-ba162f98-829d-4db1-8dc0-dd9cf5ce50ac tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:12:24 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-ba162f98-829d-4db1-8dc0-dd9cf5ce50ac tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:12:24 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-ba162f98-829d-4db1-8dc0-dd9cf5ce50ac tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:12:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-ba162f98-829d-4db1-8dc0-dd9cf5ce50ac tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589" status: 200 len: 1236 microversion: 2.1 time: 0.063306 Apr 14 02:12:24 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 349/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:12:24 2023] GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 => generated 1236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:12:26 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5728d5fc-4f3a-43af-b7a3-16c359bfd589", "tag": "c1285a44-0822-432f-8dc7-2d66454343e1"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:12:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] Creating event network-changed:c1285a44-0822-432f-8dc7-2d66454343e1 for instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 on user Apr 14 02:12:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033474 Apr 14 02:12:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 348/1048] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:12:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:12:28 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:12:28 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:12:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:28 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:12:28 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-b27d7011-4c6d-4e8d-8584-d5fdac97bee8 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 200 len: 1746 microversion: 2.1 time: 0.227420 Apr 14 02:12:28 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 352/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:12:28 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 1746 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:12:28 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:12:28 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5728d5fc-4f3a-43af-b7a3-16c359bfd589", "name": "network-vif-plugged", "status": "completed", "tag": "c1285a44-0822-432f-8dc7-2d66454343e1"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:12:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] Creating event network-vif-plugged:c1285a44-0822-432f-8dc7-2d66454343e1 for instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 on user Apr 14 02:12:28 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104252 Apr 14 02:12:28 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 350/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:12:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:12:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5728d5fc-4f3a-43af-b7a3-16c359bfd589", "name": "network-vif-plugged", "status": "completed", "tag": "c1285a44-0822-432f-8dc7-2d66454343e1"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:12:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:12:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:12:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:12:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] Creating event network-vif-plugged:c1285a44-0822-432f-8dc7-2d66454343e1 for instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 on user Apr 14 02:12:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030721 Apr 14 02:12:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 349/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:14 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:13:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-ac0b8561-b82c-42bb-9391-8a18493b965f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589" status: 200 len: 1546 microversion: 2.1 time: 0.185476 Apr 14 02:13:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 353/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:13:14 2023] GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 => generated 1546 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1580253036"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:28 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:29 user devstack@n-api.service[61837]: INFO nova.network.security_group_api [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Removing security group 1bc218d2-8354-432b-856e-fd5daaf462e6 from port e204d7f5-314e-43ce-8772-e2f288f1858f Apr 14 02:13:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-1a24c4e9-9a9e-405e-9883-b74f30dcae6f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.623649 Apr 14 02:13:29 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 351/1053] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:13:28 2023] POST /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:13:29 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:29 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:29 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:13:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] Creating event network-changed:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:13:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049221 Apr 14 02:13:29 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 350/1054] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:13:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:13:30 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:13:30 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:30 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:13:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:30 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:30 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] Creating event network-changed:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:13:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:13:30 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:13:30 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035733 Apr 14 02:13:30 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 354/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:13:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:13:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:30 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'services' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:13:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments/9f12b47d-8b55-4650-9f88-e50281b67877" status: 202 len: 0 microversion: 2.1 time: 0.185476 Apr 14 02:13:30 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 352/1056] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:13:30 2023] DELETE /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments/9f12b47d-8b55-4650-9f88-e50281b67877 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:13:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-aa1248de-23a9-4ad9-adeb-68a2fa9b346d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:13:30 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-aa1248de-23a9-4ad9-adeb-68a2fa9b346d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:13:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aa1248de-23a9-4ad9-adeb-68a2fa9b346d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aa1248de-23a9-4ad9-adeb-68a2fa9b346d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aa1248de-23a9-4ad9-adeb-68a2fa9b346d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aa1248de-23a9-4ad9-adeb-68a2fa9b346d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:13:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aa1248de-23a9-4ad9-adeb-68a2fa9b346d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:13:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-aa1248de-23a9-4ad9-adeb-68a2fa9b346d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:13:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-aa1248de-23a9-4ad9-adeb-68a2fa9b346d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057132 Apr 14 02:13:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 351/1057] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:13:30 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-21bea8a9-9687-4e47-988e-59f831301b02 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-21bea8a9-9687-4e47-988e-59f831301b02 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-21bea8a9-9687-4e47-988e-59f831301b02 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-21bea8a9-9687-4e47-988e-59f831301b02 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-21bea8a9-9687-4e47-988e-59f831301b02 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-21bea8a9-9687-4e47-988e-59f831301b02 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-21bea8a9-9687-4e47-988e-59f831301b02 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:14 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-21bea8a9-9687-4e47-988e-59f831301b02 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-21bea8a9-9687-4e47-988e-59f831301b02 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.104229 Apr 14 02:14:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 355/1058] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 02:14:14 2023] GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589/os-interface => generated 283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5728d5fc-4f3a-43af-b7a3-16c359bfd589", "tag": "c1285a44-0822-432f-8dc7-2d66454343e1"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] Creating event network-changed:c1285a44-0822-432f-8dc7-2d66454343e1 for instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 on user Apr 14 02:14:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040908 Apr 14 02:14:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 353/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:14:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b5a32b4f-25c8-416d-b99a-03faf5ea1625 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b5a32b4f-25c8-416d-b99a-03faf5ea1625 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b5a32b4f-25c8-416d-b99a-03faf5ea1625 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b5a32b4f-25c8-416d-b99a-03faf5ea1625 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b5a32b4f-25c8-416d-b99a-03faf5ea1625 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b5a32b4f-25c8-416d-b99a-03faf5ea1625 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b5a32b4f-25c8-416d-b99a-03faf5ea1625 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b5a32b4f-25c8-416d-b99a-03faf5ea1625 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:15 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b5a32b4f-25c8-416d-b99a-03faf5ea1625 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589/ips" status: 200 len: 109 microversion: 2.1 time: 0.040586 Apr 14 02:14:15 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 352/1060] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:14:15 2023] GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589/ips => generated 109 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "061ecf8a-30b1-466a-8a33-59b6281720bf"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Invalid volume: volume 061ecf8a-30b1-466a-8a33-59b6281720bf is already attached to instances: 21ac5dda-cff9-4da5-a19d-49b74491f007 Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:14:15 user devstack@n-api.service[61836]: request: POST /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589/os-volume_attachments HTTP/1.1 Apr 14 02:14:15 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:14:15 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:14:15 user devstack@n-api.service[61836]: Connection: close Apr 14 02:14:15 user devstack@n-api.service[61836]: Content-Length: 74 Apr 14 02:14:15 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:14:15 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:14:15 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:14:15 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:14:15 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:14:15 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:14:15 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:14:15 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:14:15 user devstack@n-api.service[61836]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:14:15 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:14:15 user devstack@n-api.service[61836]: Apr 14 02:14:15 user devstack@n-api.service[61836]: {"volumeAttachment": {"volumeId": "061ecf8a-30b1-466a-8a33-59b6281720bf"}} Apr 14 02:14:15 user devstack@n-api.service[61836]: method: > Apr 14 02:14:15 user devstack@n-api.service[61836]: exception: Invalid volume: volume 061ecf8a-30b1-466a-8a33-59b6281720bf is already attached to instances: 21ac5dda-cff9-4da5-a19d-49b74491f007 Apr 14 02:14:15 user devstack@n-api.service[61836]: action_args: {'server_id': '5728d5fc-4f3a-43af-b7a3-16c359bfd589', 'body': {'volumeAttachment': {'volumeId': '061ecf8a-30b1-466a-8a33-59b6281720bf'}}} Apr 14 02:14:15 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 061ecf8a-30b1-466a-8a33-59b6281720bf is already attached to instances: 21ac5dda-cff9-4da5-a19d-49b74491f007 Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 061ecf8a-30b1-466a-8a33-59b6281720bf is already attached to instances: 21ac5dda-cff9-4da5-a19d-49b74491f007 Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 061ecf8a-30b1-466a-8a33-59b6281720bf is already attached to instances: 21ac5dda-cff9-4da5-a19d-49b74491f007 Apr 14 02:14:15 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:14:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 400 to user: Invalid volume: volume 061ecf8a-30b1-466a-8a33-59b6281720bf is already attached to instances: 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:14:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-5573115b-6a05-472a-b21b-e3b0673440a3 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100237 Apr 14 02:14:15 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 356/1061] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:14:15 2023] POST /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:15 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:14:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589" status: 204 len: 0 microversion: 2.1 time: 0.123362 Apr 14 02:14:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 354/1062] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:14:15 2023] DELETE /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:15 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:16 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5728d5fc-4f3a-43af-b7a3-16c359bfd589", "name": "network-vif-unplugged", "status": "completed", "tag": "c1285a44-0822-432f-8dc7-2d66454343e1"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:14:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:16 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] Creating event network-vif-unplugged:c1285a44-0822-432f-8dc7-2d66454343e1 for instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 on user Apr 14 02:14:16 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039406 Apr 14 02:14:16 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 357/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:14:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:14:16 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:14:16 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-3bdddfa3-b8f5-4933-96b5-1f22931ea7c4 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589" status: 200 len: 1552 microversion: 2.1 time: 0.622423 Apr 14 02:14:16 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 353/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:14:15 2023] GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 => generated 1552 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:14:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-babc2f5b-f7aa-4855-9795-7f3eb5ba36af req-ae23a64e-7113-4fa2-92b0-a369020850f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5728d5fc-4f3a-43af-b7a3-16c359bfd589", "name": "network-vif-deleted", "tag": "c1285a44-0822-432f-8dc7-2d66454343e1"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:14:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-babc2f5b-f7aa-4855-9795-7f3eb5ba36af req-ae23a64e-7113-4fa2-92b0-a369020850f7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-babc2f5b-f7aa-4855-9795-7f3eb5ba36af req-ae23a64e-7113-4fa2-92b0-a369020850f7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-babc2f5b-f7aa-4855-9795-7f3eb5ba36af req-ae23a64e-7113-4fa2-92b0-a369020850f7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-babc2f5b-f7aa-4855-9795-7f3eb5ba36af req-ae23a64e-7113-4fa2-92b0-a369020850f7 service nova] Creating event network-vif-deleted:c1285a44-0822-432f-8dc7-2d66454343e1 for instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 on user Apr 14 02:14:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-babc2f5b-f7aa-4855-9795-7f3eb5ba36af req-ae23a64e-7113-4fa2-92b0-a369020850f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029388 Apr 14 02:14:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 355/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:14:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:14:18 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5728d5fc-4f3a-43af-b7a3-16c359bfd589", "name": "network-vif-plugged", "status": "completed", "tag": "c1285a44-0822-432f-8dc7-2d66454343e1"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:14:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:18 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:18 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] Creating event network-vif-plugged:c1285a44-0822-432f-8dc7-2d66454343e1 for instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 on user Apr 14 02:14:18 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030902 Apr 14 02:14:18 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 358/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:14:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:14:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-30d5b6d6-65e8-43af-bd38-ea34ed9fb995 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:14:20 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-30d5b6d6-65e8-43af-bd38-ea34ed9fb995 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:14:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-30d5b6d6-65e8-43af-bd38-ea34ed9fb995 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-30d5b6d6-65e8-43af-bd38-ea34ed9fb995 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-30d5b6d6-65e8-43af-bd38-ea34ed9fb995 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-30d5b6d6-65e8-43af-bd38-ea34ed9fb995 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-30d5b6d6-65e8-43af-bd38-ea34ed9fb995 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:20 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-30d5b6d6-65e8-43af-bd38-ea34ed9fb995 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-30d5b6d6-65e8-43af-bd38-ea34ed9fb995 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040908 Apr 14 02:14:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 354/1067] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:14:20 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:14:20 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:14:20 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:14:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:20 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] HTTP exception thrown: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a is not attached to volume 9f12b47d-8b55-4650-9f88-e50281b67877 Apr 14 02:14:21 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Request method failure captured: Apr 14 02:14:21 user devstack@n-api.service[61837]: request: DELETE /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments/9f12b47d-8b55-4650-9f88-e50281b67877 HTTP/1.1 Apr 14 02:14:21 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:14:21 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:14:21 user devstack@n-api.service[61837]: Connection: close Apr 14 02:14:21 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:14:21 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:14:21 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:14:21 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:14:21 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLXNOTOT2jqdBtIjnSShr1dCfOXpNhBeMaB1EJbmYEYUUjaoetdgf57CFmHoebJyiQ0LpkmWatJ_9BFSM9V18vl03n4UV50jp8dVeiLy3z09xo71Q6lkLdWTTgkztfKkCbu30PUejASEgS2Tuv1AzjxAAYb8DVzHBfplai0EsIFSZbM Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Project-Id: 20723e8ba2f5480b8c17e6c4fc8fff9f Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}] Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Tenant: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Tenant-Id: 20723e8ba2f5480b8c17e6c4fc8fff9f Apr 14 02:14:21 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:14:21 user devstack@n-api.service[61837]: X-User: tempest-TestMinimumBasicScenario-1976287714-project-member Apr 14 02:14:21 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:14:21 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:14:21 user devstack@n-api.service[61837]: X-User-Id: 19633f8d769c4e50b5e6c9a75497b510 Apr 14 02:14:21 user devstack@n-api.service[61837]: X-User-Name: tempest-TestMinimumBasicScenario-1976287714-project-member Apr 14 02:14:21 user devstack@n-api.service[61837]: method: > Apr 14 02:14:21 user devstack@n-api.service[61837]: exception: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a is not attached to volume 9f12b47d-8b55-4650-9f88-e50281b67877 Apr 14 02:14:21 user devstack@n-api.service[61837]: action_args: {'server_id': '9b29ba99-4234-4bbc-80a2-ad49127e8c9a', 'id': '9f12b47d-8b55-4650-9f88-e50281b67877'} Apr 14 02:14:21 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9f12b47d-8b55-4650-9f88-e50281b67877. Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a is not attached to volume 9f12b47d-8b55-4650-9f88-e50281b67877 Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a is not attached to volume 9f12b47d-8b55-4650-9f88-e50281b67877 Apr 14 02:14:21 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:14:21 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Returning 404 to user: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a is not attached to volume 9f12b47d-8b55-4650-9f88-e50281b67877 {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:14:21 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-78e95ac2-c547-42b8-8e8a-69539eb5ca16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments/9f12b47d-8b55-4650-9f88-e50281b67877" status: 404 len: 154 microversion: 2.1 time: 0.088076 Apr 14 02:14:21 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 356/1068] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:14:20 2023] DELETE /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/os-volume_attachments/9f12b47d-8b55-4650-9f88-e50281b67877 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:14:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:14:24 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:14:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:24 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:14:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 204 len: 0 microversion: 2.1 time: 0.128343 Apr 14 02:14:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 359/1069] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:14:24 2023] DELETE /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:14:24 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:14:24 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:14:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:24 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:24 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:14:24 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ba70f74c-a460-4865-a5b8-d06cb972ca40 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 200 len: 1541 microversion: 2.1 time: 0.250183 Apr 14 02:14:24 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 355/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:14:24 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 1541 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:14:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-unplugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:14:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] Creating event network-vif-unplugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:14:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030871 Apr 14 02:14:24 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 357/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:14:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}, {"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}, {"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}, {"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-unplugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}, {"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}, {"server_uuid": "9b29ba99-4234-4bbc-80a2-ad49127e8c9a", "name": "network-vif-deleted", "tag": "e204d7f5-314e-43ce-8772-e2f288f1858f"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:14:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:14:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:14:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:14:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Creating event network-vif-plugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:14:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Creating event network-vif-plugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:14:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Creating event network-vif-plugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:14:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Creating event network-vif-unplugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:14:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Creating event network-vif-plugged:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:14:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Creating event network-vif-deleted:e204d7f5-314e-43ce-8772-e2f288f1858f for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a on user Apr 14 02:14:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.033221 Apr 14 02:14:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 360/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=22 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:06 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:15:06 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 HTTP/1.1 Apr 14 02:15:06 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:15:06 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:15:06 user devstack@n-api.service[61835]: Connection: close Apr 14 02:15:06 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:15:06 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:15:06 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:15:06 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:15:06 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:15:06 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:15:06 user devstack@n-api.service[61835]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:15:06 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:15:06 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:15:06 user devstack@n-api.service[61835]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:15:06 user devstack@n-api.service[61835]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:15:06 user devstack@n-api.service[61835]: method: > Apr 14 02:15:06 user devstack@n-api.service[61835]: exception: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:15:06 user devstack@n-api.service[61835]: action_args: {'id': '5728d5fc-4f3a-43af-b7a3-16c359bfd589'} Apr 14 02:15:06 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:15:06 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:15:06 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:15:06 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-372ce2b0-c99a-4c28-982e-ebcd40b7793b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589" status: 404 len: 111 microversion: 2.1 time: 0.046962 Apr 14 02:15:06 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 356/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:15:06 2023] GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:15:06 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:06 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:06 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-5bb755c9-1189-4e66-a378-d2f67900c0e9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '.version_select at 0x7fd420d2a7a0>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:06 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-5bb755c9-1189-4e66-a378-d2f67900c0e9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199811974" status: 202 len: 0 microversion: 2.1 time: 0.031380 Apr 14 02:15:06 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 358/1074] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 02:15:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199811974 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:07 user devstack@n-api.service[61836]: DEBUG nova.objects.instance [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'services' on Instance uuid 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=61836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:15:07 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-volume_attachments/061ecf8a-30b1-466a-8a33-59b6281720bf" status: 202 len: 0 microversion: 2.1 time: 0.163919 Apr 14 02:15:07 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 361/1075] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:15:07 2023] DELETE /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-volume_attachments/061ecf8a-30b1-466a-8a33-59b6281720bf => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:15:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c8bb6acf-6931-4c68-8fb0-a15abf4f72c5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:07 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-c8bb6acf-6931-4c68-8fb0-a15abf4f72c5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:15:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8bb6acf-6931-4c68-8fb0-a15abf4f72c5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8bb6acf-6931-4c68-8fb0-a15abf4f72c5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8bb6acf-6931-4c68-8fb0-a15abf4f72c5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8bb6acf-6931-4c68-8fb0-a15abf4f72c5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8bb6acf-6931-4c68-8fb0-a15abf4f72c5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c8bb6acf-6931-4c68-8fb0-a15abf4f72c5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-c8bb6acf-6931-4c68-8fb0-a15abf4f72c5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047917 Apr 14 02:15:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 357/1076] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:15:07 2023] GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] HTTP exception thrown: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a could not be found. Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Request method failure captured: Apr 14 02:15:14 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a HTTP/1.1 Apr 14 02:15:14 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:15:14 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:15:14 user devstack@n-api.service[61837]: Connection: close Apr 14 02:15:14 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:15:14 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:15:14 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:15:14 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:15:14 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLXNOTOT2jqdBtIjnSShr1dCfOXpNhBeMaB1EJbmYEYUUjaoetdgf57CFmHoebJyiQ0LpkmWatJ_9BFSM9V18vl03n4UV50jp8dVeiLy3z09xo71Q6lkLdWTTgkztfKkCbu30PUejASEgS2Tuv1AzjxAAYb8DVzHBfplai0EsIFSZbM Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Project-Id: 20723e8ba2f5480b8c17e6c4fc8fff9f Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Project-Name: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}] Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Tenant: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Tenant-Id: 20723e8ba2f5480b8c17e6c4fc8fff9f Apr 14 02:15:14 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:15:14 user devstack@n-api.service[61837]: X-User: tempest-TestMinimumBasicScenario-1976287714-project-member Apr 14 02:15:14 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:15:14 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:15:14 user devstack@n-api.service[61837]: X-User-Id: 19633f8d769c4e50b5e6c9a75497b510 Apr 14 02:15:14 user devstack@n-api.service[61837]: X-User-Name: tempest-TestMinimumBasicScenario-1976287714-project-member Apr 14 02:15:14 user devstack@n-api.service[61837]: method: > Apr 14 02:15:14 user devstack@n-api.service[61837]: exception: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a could not be found. Apr 14 02:15:14 user devstack@n-api.service[61837]: action_args: {'id': '9b29ba99-4234-4bbc-80a2-ad49127e8c9a'} Apr 14 02:15:14 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a could not be found. Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a could not be found. Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a could not be found. Apr 14 02:15:14 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:15:14 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Returning 404 to user: Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:15:14 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f66d6a80-de33-4934-a99e-fbb8b9b1ca5e tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a" status: 404 len: 111 microversion: 2.1 time: 0.032557 Apr 14 02:15:14 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 359/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:15:14 2023] GET /compute/v2.1/servers/9b29ba99-4234-4bbc-80a2-ad49127e8c9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:15:14 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-52fc6b9b-9b67-4491-8c0c-f9e6fbfe7db0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '.version_select at 0x7fd420e25f30>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-52fc6b9b-9b67-4491-8c0c-f9e6fbfe7db0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1668215586" status: 202 len: 0 microversion: 2.1 time: 0.021954 Apr 14 02:15:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 362/1078] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 02:15:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1668215586 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:15:17 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-ce15cc88-271e-4583-acd5-68842cbda9c9 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'create', calling method: .version_select at 0x7fd420ea28c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-232131221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/8dDuRjCJcjSWFSlIIQBjaCQYsWY9jcPIgqBXOlo6NSNyeF/zqlrB4m5QH/AVXVYI5JCwYqy+IR/fGoWCXNpPwugqxmAh3nJdTZo0B2P/965Ah2uH7rPja1jX0NXwcFQ=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:15:17 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-ce15cc88-271e-4583-acd5-68842cbda9c9 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting quotas for project 20723e8ba2f5480b8c17e6c4fc8fff9f. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:15:17 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-ce15cc88-271e-4583-acd5-68842cbda9c9 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting quotas for user 19633f8d769c4e50b5e6c9a75497b510 and project 20723e8ba2f5480b8c17e6c4fc8fff9f. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:15:17 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-ce15cc88-271e-4583-acd5-68842cbda9c9 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057199 Apr 14 02:15:17 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 358/1079] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:15:17 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-684753578", "imageRef": "0f1079ad-d248-4167-b5fd-2792d9e7c59f", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-232131221", "networks": [{"uuid": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b"}]}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] validate_networks() for [('6a2a0716-97e3-42a7-bdf8-5f5548cf550b', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting quotas for project 20723e8ba2f5480b8c17e6c4fc8fff9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting quotas for user 19633f8d769c4e50b5e6c9a75497b510 and project 20723e8ba2f5480b8c17e6c4fc8fff9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:15:17 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0f1079ad-d248-4167-b5fd-2792d9e7c59f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:15:17 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.531675 Apr 14 02:15:17 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 360/1080] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:15:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:15:17 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:17 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-bf654719-2ad4-45c1-80bb-1cbd71a7aa02 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:17 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-bf654719-2ad4-45c1-80bb-1cbd71a7aa02 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:15:17 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-bf654719-2ad4-45c1-80bb-1cbd71a7aa02 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:15:17 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-bf654719-2ad4-45c1-80bb-1cbd71a7aa02 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 200 len: 1251 microversion: 2.1 time: 0.071815 Apr 14 02:15:17 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 363/1081] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:15:17 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 1251 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:15:19 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:19 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:15:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:19 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] Creating event network-changed:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:15:19 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029532 Apr 14 02:15:19 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 359/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:15:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:15:22 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-plugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:15:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] Creating event network-vif-plugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:15:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029678 Apr 14 02:15:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 361/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:15:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:15:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-plugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:15:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] Creating event network-vif-plugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:15:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029814 Apr 14 02:15:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 364/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:15:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:15:57 user devstack@n-api.service[61835]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 02:15:57 user devstack@n-api.service[61835]: Fri Apr 14 02:15:57 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-volume_attachments (ip 10.0.0.210) !!! Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-00c44721-4483-48f7-9e56-e98b595d7a21 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-00c44721-4483-48f7-9e56-e98b595d7a21 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00c44721-4483-48f7-9e56-e98b595d7a21 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00c44721-4483-48f7-9e56-e98b595d7a21 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00c44721-4483-48f7-9e56-e98b595d7a21 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00c44721-4483-48f7-9e56-e98b595d7a21 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00c44721-4483-48f7-9e56-e98b595d7a21 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:57 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00c44721-4483-48f7-9e56-e98b595d7a21 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:57 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-00c44721-4483-48f7-9e56-e98b595d7a21 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111425 Apr 14 02:15:57 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 360/1085] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:15:57 2023] GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:57 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:15:57 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007" status: 204 len: 0 microversion: 2.1 time: 0.119627 Apr 14 02:15:57 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 362/1086] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:15:57 2023] DELETE /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:57 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:58 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:15:58 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f928abd5-2703-4da3-92c2-e3f64508edfd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007" status: 200 len: 1669 microversion: 2.1 time: 0.301859 Apr 14 02:15:58 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 365/1087] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:15:57 2023] GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 => generated 1669 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:15:58 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ac5dda-cff9-4da5-a19d-49b74491f007", "name": "network-vif-unplugged", "status": "completed", "tag": "38b47774-08a0-4e14-a236-fcab2f3bdb06"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:15:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:58 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:58 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] Creating event network-vif-unplugged:38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance 21ac5dda-cff9-4da5-a19d-49b74491f007 on user Apr 14 02:15:58 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106097 Apr 14 02:15:58 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 361/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:15:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:15:59 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ac5dda-cff9-4da5-a19d-49b74491f007", "name": "network-vif-deleted", "tag": "38b47774-08a0-4e14-a236-fcab2f3bdb06"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:15:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:15:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:15:59 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:15:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] Creating event network-vif-deleted:38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance 21ac5dda-cff9-4da5-a19d-49b74491f007 on user Apr 14 02:15:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029774 Apr 14 02:15:59 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 363/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:15:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:16:00 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ac5dda-cff9-4da5-a19d-49b74491f007", "name": "network-vif-plugged", "status": "completed", "tag": "38b47774-08a0-4e14-a236-fcab2f3bdb06"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:16:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:00 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] Creating event network-vif-plugged:38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance 21ac5dda-cff9-4da5-a19d-49b74491f007 on user Apr 14 02:16:00 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028273 Apr 14 02:16:00 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 366/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:16:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:16:07 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:16:07 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:16:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:07 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:07 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:16:07 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d740654d-5fb5-492b-901b-73f806d58a8b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 200 len: 1535 microversion: 2.1 time: 0.154887 Apr 14 02:16:07 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 362/1091] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:16:07 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 1535 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:16:48 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 HTTP/1.1 Apr 14 02:16:48 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:16:48 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:16:48 user devstack@n-api.service[61837]: Connection: close Apr 14 02:16:48 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:16:48 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:16:48 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:16:48 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:16:48 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:16:48 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:16:48 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:16:48 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:16:48 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:16:48 user devstack@n-api.service[61837]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:16:48 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:16:48 user devstack@n-api.service[61837]: method: > Apr 14 02:16:48 user devstack@n-api.service[61837]: exception: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:16:48 user devstack@n-api.service[61837]: action_args: {'id': '21ac5dda-cff9-4da5-a19d-49b74491f007'} Apr 14 02:16:48 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:16:48 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:16:48 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:16:48 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-71847f38-7459-44b3-ac2b-d8958a0a4811 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007" status: 404 len: 111 microversion: 2.1 time: 0.035254 Apr 14 02:16:48 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 364/1092] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:16:48 2023] GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:16:48 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:48 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:48 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-91f0aef0-aaa1-46be-8636-47df15ec2c41 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '.version_select at 0x7fd4210f8040>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:16:48 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-91f0aef0-aaa1-46be-8636-47df15ec2c41 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867176451" status: 202 len: 0 microversion: 2.1 time: 0.027557 Apr 14 02:16:48 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 367/1093] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 02:16:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867176451 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:16:49 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-47c0f469-52ea-46a0-a1a2-fb93fd74d348 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: .version_select at 0x7fd420fb3d90>, body: {"keypair": {"name": "tempest-keypair-192458830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsISeJYcsQzj300xI0rFprFbRIr/LQtgaSqSbXJ1Pr6kf8uYfeXju7g2gvvzsDVFTZUYIhmhRe5xZaNG1dr1NLOQ1SqimNbr3mSTWJJiZg26iWZwNGUe2i7uw8Bs59tSQ=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:16:49 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:49 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=14 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:16:49 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-47c0f469-52ea-46a0-a1a2-fb93fd74d348 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:16:49 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-47c0f469-52ea-46a0-a1a2-fb93fd74d348 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for user 168a0142cf984aacb1f087adcaa96468 and project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:16:49 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-47c0f469-52ea-46a0-a1a2-fb93fd74d348 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050551 Apr 14 02:16:49 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 363/1094] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:16:49 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:16:50 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-872821442", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "981c880a-2147-4da6-8021-a03d0aee3f3d"}], "security_groups": [{"name": "tempest-securitygroup--1711919328"}], "key_name": "tempest-keypair-192458830", "user_data": "}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] validate_networks() for [('981c880a-2147-4da6-8021-a03d0aee3f3d', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for user 168a0142cf984aacb1f087adcaa96468 and project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:16:51 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:16:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.680942 Apr 14 02:16:51 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 365/1095] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:16:50 2023] POST /compute/v2.1/servers => generated 400 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:16:51 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-041f2fd0-c5c0-4692-93f1-435cffb38d8e tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:16:51 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-041f2fd0-c5c0-4692-93f1-435cffb38d8e tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:16:51 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-041f2fd0-c5c0-4692-93f1-435cffb38d8e tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:16:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-041f2fd0-c5c0-4692-93f1-435cffb38d8e tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2" status: 200 len: 1234 microversion: 2.1 time: 0.164017 Apr 14 02:16:51 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 368/1096] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:16:51 2023] GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 => generated 1234 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:16:53 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b243a71-802b-40f4-a374-16ecc2bae0f2", "tag": "ac234ca2-fa32-4f28-bcab-47b552c9b02e"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:16:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:53 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:53 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] Creating event network-changed:ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 on user Apr 14 02:16:53 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079983 Apr 14 02:16:53 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 364/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:16:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:16:56 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b243a71-802b-40f4-a374-16ecc2bae0f2", "name": "network-vif-plugged", "status": "completed", "tag": "ac234ca2-fa32-4f28-bcab-47b552c9b02e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:16:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:56 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:56 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] Creating event network-vif-plugged:ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 on user Apr 14 02:16:56 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040614 Apr 14 02:16:56 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 366/1098] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:16:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:16:58 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b243a71-802b-40f4-a374-16ecc2bae0f2", "name": "network-vif-plugged", "status": "completed", "tag": "ac234ca2-fa32-4f28-bcab-47b552c9b02e"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:16:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:16:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:16:58 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:16:58 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] Creating event network-vif-plugged:ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 on user Apr 14 02:16:58 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029617 Apr 14 02:16:58 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 369/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:16:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:08 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:17:08 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-66203454-5d40-40a8-bd48-e1db4d11b588 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 200 len: 1535 microversion: 2.1 time: 0.173578 Apr 14 02:17:08 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 365/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:17:08 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 1535 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Searching by: {'deleted': False, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f'} {{(pid=61837) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:08 user devstack@n-api.service[61837]: DEBUG nova.compute.multi_cell_list [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61837) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 02:17:08 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-10e587a5-7a25-4f22-9f68-bfa99757adf3 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.157173 Apr 14 02:17:08 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 367/1101] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 02:17:08 2023] GET /compute/v2.1/servers => generated 340 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:08 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:17:08 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-5a0f8b11-a132-4c45-a286-4be6b60e1301 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 200 len: 1535 microversion: 2.1 time: 0.146960 Apr 14 02:17:08 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 370/1102] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:17:08 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 1535 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:17:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e519936-e25f-479c-a1c3-f8fcb9f1af51"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:17:11 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:17:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288379 Apr 14 02:17:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 366/1103] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:17:11 2023] POST /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=8 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:19 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:17:19 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-559b17e3-971a-4b44-b4e0-e8e30e946108 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 200 len: 1581 microversion: 2.1 time: 0.424701 Apr 14 02:17:19 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 368/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:17:19 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 1581 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:17:21 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:17:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:21 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:21 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] Creating event network-changed:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:21 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035701 Apr 14 02:17:21 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 371/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:17:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1269632784"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:22 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:22 user devstack@n-api.service[61835]: INFO nova.network.security_group_api [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Adding security group 1aadd528-66f7-4415-b653-35a2aa3cb087 to port 658d7098-ff69-45ed-8875-15a23a6bdb98 Apr 14 02:17:22 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-2b67953a-d6d2-4ddd-b2be-f76f1b909ede tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/action" status: 202 len: 0 microversion: 2.1 time: 0.572150 Apr 14 02:17:22 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 367/1106] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:17:22 2023] POST /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:17:22 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:17:22 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:17:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:22 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:22 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:17:22 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-c5f52145-324e-4f29-98b7-005630d8a6d2 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 200 len: 1746 microversion: 2.1 time: 0.153666 Apr 14 02:17:22 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 369/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:17:22 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:17:23 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:17:23 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:17:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:23 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:23 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:17:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:23 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:23 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/action" status: 202 len: 0 microversion: 2.1 time: 0.091319 Apr 14 02:17:23 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 372/1108] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:17:23 2023] POST /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:17:23 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:17:23 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:17:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] Creating event network-changed:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:23 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:23 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:23 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:23 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:23 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:23 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:23 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075554 Apr 14 02:17:23 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 368/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:17:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:17:23 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:17:23 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-88eafc8f-adc3-4677-ac0b-e18a924a3e60 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 200 len: 1738 microversion: 2.1 time: 0.250795 Apr 14 02:17:23 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 370/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:17:23 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 1738 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:17:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-unplugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:17:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] Creating event network-vif-unplugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030877 Apr 14 02:17:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 373/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:17:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:17:28 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-plugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}, {"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-plugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}, {"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-plugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}, {"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-unplugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}, {"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-plugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:17:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:28 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:28 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Creating event network-vif-plugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:28 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Creating event network-vif-plugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:28 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Creating event network-vif-plugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:28 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Creating event network-vif-unplugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:28 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Creating event network-vif-plugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:28 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.052852 Apr 14 02:17:28 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 369/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:17:28 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:17:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-plugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}, {"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-plugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:17:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:30 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Creating event network-vif-plugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Creating event network-vif-plugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:17:30 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036682 Apr 14 02:17:30 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 371/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:17:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:17:41 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:17:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-0c1f693a-5dd8-435c-ae52-14ac1638c323 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2" status: 200 len: 1544 microversion: 2.1 time: 0.150878 Apr 14 02:17:41 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 374/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:17:41 2023] GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 => generated 1544 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:13 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:18:13 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-c1dfe39b-128b-41f6-81cb-82fa04b7a06f tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 200 len: 1746 microversion: 2.1 time: 0.189784 Apr 14 02:18:13 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 370/1115] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:18:13 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 1746 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:18:41 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=8 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:41 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=20 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:42 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d0cb42ff-7a94-49d7-8918-8295247012a9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:18:42 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-d0cb42ff-7a94-49d7-8918-8295247012a9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:18:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d0cb42ff-7a94-49d7-8918-8295247012a9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d0cb42ff-7a94-49d7-8918-8295247012a9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d0cb42ff-7a94-49d7-8918-8295247012a9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d0cb42ff-7a94-49d7-8918-8295247012a9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d0cb42ff-7a94-49d7-8918-8295247012a9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d0cb42ff-7a94-49d7-8918-8295247012a9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d0cb42ff-7a94-49d7-8918-8295247012a9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.139888 Apr 14 02:18:42 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 372/1116] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 02:18:41 2023] GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-interface => generated 282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:18:42 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:42 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:42 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b243a71-802b-40f4-a374-16ecc2bae0f2", "tag": "ac234ca2-fa32-4f28-bcab-47b552c9b02e"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:18:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] Creating event network-changed:ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 on user Apr 14 02:18:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038961 Apr 14 02:18:43 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 375/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:18:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-86a01a4c-76c1-468d-a67d-fce563fae1e5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-86a01a4c-76c1-468d-a67d-fce563fae1e5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=6 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-86a01a4c-76c1-468d-a67d-fce563fae1e5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-86a01a4c-76c1-468d-a67d-fce563fae1e5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-86a01a4c-76c1-468d-a67d-fce563fae1e5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-86a01a4c-76c1-468d-a67d-fce563fae1e5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-86a01a4c-76c1-468d-a67d-fce563fae1e5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:43 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-86a01a4c-76c1-468d-a67d-fce563fae1e5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:43 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-86a01a4c-76c1-468d-a67d-fce563fae1e5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/ips" status: 200 len: 108 microversion: 2.1 time: 0.045256 Apr 14 02:18:43 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 371/1118] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:18:43 2023] GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/ips => generated 108 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:18:44 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de3bdf10-3f9b-49fc-b630-83ff7b711656"}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:18:44 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:18:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:44 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:44 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297384 Apr 14 02:18:44 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 373/1119] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:18:44 2023] POST /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de3bdf10-3f9b-49fc-b630-83ff7b711656"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Invalid volume: volume de3bdf10-3f9b-49fc-b630-83ff7b711656 is already attached to instances: 5b243a71-802b-40f4-a374-16ecc2bae0f2 Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:18:51 user devstack@n-api.service[61836]: request: POST /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments HTTP/1.1 Apr 14 02:18:51 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:18:51 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:18:51 user devstack@n-api.service[61836]: Connection: close Apr 14 02:18:51 user devstack@n-api.service[61836]: Content-Length: 74 Apr 14 02:18:51 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:18:51 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:18:51 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:18:51 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:18:51 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:18:51 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:18:51 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:18:51 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:18:51 user devstack@n-api.service[61836]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:18:51 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:18:51 user devstack@n-api.service[61836]: Apr 14 02:18:51 user devstack@n-api.service[61836]: {"volumeAttachment": {"volumeId": "de3bdf10-3f9b-49fc-b630-83ff7b711656"}} Apr 14 02:18:51 user devstack@n-api.service[61836]: method: > Apr 14 02:18:51 user devstack@n-api.service[61836]: exception: Invalid volume: volume de3bdf10-3f9b-49fc-b630-83ff7b711656 is already attached to instances: 5b243a71-802b-40f4-a374-16ecc2bae0f2 Apr 14 02:18:51 user devstack@n-api.service[61836]: action_args: {'server_id': '5b243a71-802b-40f4-a374-16ecc2bae0f2', 'body': {'volumeAttachment': {'volumeId': 'de3bdf10-3f9b-49fc-b630-83ff7b711656'}}} Apr 14 02:18:51 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume de3bdf10-3f9b-49fc-b630-83ff7b711656 is already attached to instances: 5b243a71-802b-40f4-a374-16ecc2bae0f2 Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume de3bdf10-3f9b-49fc-b630-83ff7b711656 is already attached to instances: 5b243a71-802b-40f4-a374-16ecc2bae0f2 Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume de3bdf10-3f9b-49fc-b630-83ff7b711656 is already attached to instances: 5b243a71-802b-40f4-a374-16ecc2bae0f2 Apr 14 02:18:51 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:18:51 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 400 to user: Invalid volume: volume de3bdf10-3f9b-49fc-b630-83ff7b711656 is already attached to instances: 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:18:51 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-1f50129d-fe33-4ca0-8550-323a51f94baf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110649 Apr 14 02:18:51 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 376/1120] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:18:51 2023] POST /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 02:18:51 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:18:51 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:18:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:51 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:51 user devstack@n-api.service[61835]: DEBUG nova.objects.instance [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'services' on Instance uuid 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=61835) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:18:51 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments/de3bdf10-3f9b-49fc-b630-83ff7b711656" status: 202 len: 0 microversion: 2.1 time: 0.162761 Apr 14 02:18:51 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 372/1121] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:18:51 2023] DELETE /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments/de3bdf10-3f9b-49fc-b630-83ff7b711656 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:18:51 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d8e93980-4b40-4305-9de9-ee4913da1c87 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:18:51 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-d8e93980-4b40-4305-9de9-ee4913da1c87 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:18:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d8e93980-4b40-4305-9de9-ee4913da1c87 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d8e93980-4b40-4305-9de9-ee4913da1c87 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d8e93980-4b40-4305-9de9-ee4913da1c87 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d8e93980-4b40-4305-9de9-ee4913da1c87 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:18:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d8e93980-4b40-4305-9de9-ee4913da1c87 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:18:51 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d8e93980-4b40-4305-9de9-ee4913da1c87 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:18:51 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d8e93980-4b40-4305-9de9-ee4913da1c87 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049204 Apr 14 02:18:51 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 374/1122] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:18:51 2023] GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1269632784"}} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:13 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:14 user devstack@n-api.service[61836]: INFO nova.network.security_group_api [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Removing security group 1aadd528-66f7-4415-b653-35a2aa3cb087 from port 658d7098-ff69-45ed-8875-15a23a6bdb98 Apr 14 02:19:14 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-128a534c-bf94-4c90-8114-4b5bdaeec226 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/action" status: 202 len: 0 microversion: 2.1 time: 0.582049 Apr 14 02:19:14 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 377/1123] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 02:19:13 2023] POST /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:19:14 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:14 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:14 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:19:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:14 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] Creating event network-changed:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:19:14 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039410 Apr 14 02:19:14 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 373/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:19:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:15 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'services' on Instance uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:19:15 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments/8e519936-e25f-479c-a1c3-f8fcb9f1af51" status: 202 len: 0 microversion: 2.1 time: 0.195720 Apr 14 02:19:15 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 375/1125] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:19:15 2023] DELETE /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments/8e519936-e25f-479c-a1c3-f8fcb9f1af51 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:19:15 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-08cb704c-f573-4f0d-8993-a5229cfae259 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:19:15 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-08cb704c-f573-4f0d-8993-a5229cfae259 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:19:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08cb704c-f573-4f0d-8993-a5229cfae259 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08cb704c-f573-4f0d-8993-a5229cfae259 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08cb704c-f573-4f0d-8993-a5229cfae259 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08cb704c-f573-4f0d-8993-a5229cfae259 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08cb704c-f573-4f0d-8993-a5229cfae259 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:15 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-08cb704c-f573-4f0d-8993-a5229cfae259 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:15 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-08cb704c-f573-4f0d-8993-a5229cfae259 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052864 Apr 14 02:19:15 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 378/1126] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:19:15 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:19:16 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:19:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:16 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:16 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] Creating event network-changed:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:19:16 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030002 Apr 14 02:19:16 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 374/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:19:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-acf350c9-03b5-4457-8054-a9a6d28d9c4a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-acf350c9-03b5-4457-8054-a9a6d28d9c4a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-acf350c9-03b5-4457-8054-a9a6d28d9c4a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-acf350c9-03b5-4457-8054-a9a6d28d9c4a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-acf350c9-03b5-4457-8054-a9a6d28d9c4a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-acf350c9-03b5-4457-8054-a9a6d28d9c4a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-acf350c9-03b5-4457-8054-a9a6d28d9c4a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:41 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-acf350c9-03b5-4457-8054-a9a6d28d9c4a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:41 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-acf350c9-03b5-4457-8054-a9a6d28d9c4a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053059 Apr 14 02:19:41 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 376/1128] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:19:41 2023] GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=10 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:41 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Going to try to terminate instance {{(pid=61836) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:19:41 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2" status: 204 len: 0 microversion: 2.1 time: 0.112081 Apr 14 02:19:41 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 379/1129] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:19:41 2023] DELETE /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:41 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:42 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b243a71-802b-40f4-a374-16ecc2bae0f2", "name": "network-vif-unplugged", "status": "completed", "tag": "ac234ca2-fa32-4f28-bcab-47b552c9b02e"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:19:42 user devstack@n-api.service[61835]: DEBUG nova.policy [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61835) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:19:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:42 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:42 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-5f79d41a-e6cb-4343-a178-f4542ec2a58f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2" status: 200 len: 1669 microversion: 2.1 time: 0.233542 Apr 14 02:19:42 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 375/1130] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:19:41 2023] GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 => generated 1669 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:19:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] Creating event network-vif-unplugged:ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 on user Apr 14 02:19:42 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036657 Apr 14 02:19:42 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 377/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:19:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:19:43 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-c7c9aa80-291d-48b8-bfda-38ffbe0befcf req-3bfff320-a0eb-4a82-a2f5-4f13e2565033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b243a71-802b-40f4-a374-16ecc2bae0f2", "name": "network-vif-deleted", "tag": "ac234ca2-fa32-4f28-bcab-47b552c9b02e"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:19:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c7c9aa80-291d-48b8-bfda-38ffbe0befcf req-3bfff320-a0eb-4a82-a2f5-4f13e2565033 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c7c9aa80-291d-48b8-bfda-38ffbe0befcf req-3bfff320-a0eb-4a82-a2f5-4f13e2565033 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:43 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-c7c9aa80-291d-48b8-bfda-38ffbe0befcf req-3bfff320-a0eb-4a82-a2f5-4f13e2565033 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-c7c9aa80-291d-48b8-bfda-38ffbe0befcf req-3bfff320-a0eb-4a82-a2f5-4f13e2565033 service nova] Creating event network-vif-deleted:ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 on user Apr 14 02:19:43 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-c7c9aa80-291d-48b8-bfda-38ffbe0befcf req-3bfff320-a0eb-4a82-a2f5-4f13e2565033 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031071 Apr 14 02:19:43 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 380/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:19:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:19:44 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b243a71-802b-40f4-a374-16ecc2bae0f2", "name": "network-vif-plugged", "status": "completed", "tag": "ac234ca2-fa32-4f28-bcab-47b552c9b02e"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:19:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:19:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:19:44 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:19:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] Creating event network-vif-plugged:ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 on user Apr 14 02:19:44 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036817 Apr 14 02:19:44 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 376/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:19:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=8 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-dd3af33d-ab13-414e-b7af-21ddd1f75966 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-dd3af33d-ab13-414e-b7af-21ddd1f75966 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd3af33d-ab13-414e-b7af-21ddd1f75966 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd3af33d-ab13-414e-b7af-21ddd1f75966 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd3af33d-ab13-414e-b7af-21ddd1f75966 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd3af33d-ab13-414e-b7af-21ddd1f75966 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd3af33d-ab13-414e-b7af-21ddd1f75966 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:05 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd3af33d-ab13-414e-b7af-21ddd1f75966 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:05 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-dd3af33d-ab13-414e-b7af-21ddd1f75966 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130974 Apr 14 02:20:05 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 378/1134] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:20:05 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] HTTP exception thrown: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 is not attached to volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51 Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Request method failure captured: Apr 14 02:20:05 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments/8e519936-e25f-479c-a1c3-f8fcb9f1af51 HTTP/1.1 Apr 14 02:20:05 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:20:05 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:20:05 user devstack@n-api.service[61836]: Connection: close Apr 14 02:20:05 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:20:05 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:20:05 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:20:05 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:20:05 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLXNOTOT2jqdBtIjnSShr1dCfOXpNhBeMaB1EJbmYEYUUjaoetdgf57CFmHoebJyiQ0LpkmWatJ_9BFSM9V18vl03n4UV50jp8dVeiLy3z09xo71Q6lkLdWTTgkztfKkCbu30PUejASEgS2Tuv1AzjxAAYb8DVzHBfplai0EsIFSZbM Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Project-Id: 20723e8ba2f5480b8c17e6c4fc8fff9f Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Project-Name: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}] Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Tenant: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Tenant-Id: 20723e8ba2f5480b8c17e6c4fc8fff9f Apr 14 02:20:05 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:20:05 user devstack@n-api.service[61836]: X-User: tempest-TestMinimumBasicScenario-1976287714-project-member Apr 14 02:20:05 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:20:05 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:20:05 user devstack@n-api.service[61836]: X-User-Id: 19633f8d769c4e50b5e6c9a75497b510 Apr 14 02:20:05 user devstack@n-api.service[61836]: X-User-Name: tempest-TestMinimumBasicScenario-1976287714-project-member Apr 14 02:20:05 user devstack@n-api.service[61836]: method: > Apr 14 02:20:05 user devstack@n-api.service[61836]: exception: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 is not attached to volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51 Apr 14 02:20:05 user devstack@n-api.service[61836]: action_args: {'server_id': '3f1e74ea-fe8b-4c37-aa30-21f7e17db259', 'id': '8e519936-e25f-479c-a1c3-f8fcb9f1af51'} Apr 14 02:20:05 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8e519936-e25f-479c-a1c3-f8fcb9f1af51. Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 is not attached to volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51 Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 is not attached to volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51 Apr 14 02:20:05 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:20:05 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Returning 404 to user: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 is not attached to volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51 {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:20:05 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-187843b6-7590-4310-bec2-0f82a97b563d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments/8e519936-e25f-479c-a1c3-f8fcb9f1af51" status: 404 len: 154 microversion: 2.1 time: 0.101565 Apr 14 02:20:05 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 381/1135] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:20:05 2023] DELETE /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/os-volume_attachments/8e519936-e25f-479c-a1c3-f8fcb9f1af51 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:09 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Going to try to terminate instance {{(pid=61835) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:20:09 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 204 len: 0 microversion: 2.1 time: 0.118052 Apr 14 02:20:09 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 377/1136] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:20:09 2023] DELETE /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:20:09 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:20:09 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:20:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:09 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:09 user devstack@n-api.service[61837]: DEBUG nova.policy [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61837) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:20:09 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f7ba3cd1-5f0d-4575-90c0-08b0858defc0 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 200 len: 1541 microversion: 2.1 time: 0.219219 Apr 14 02:20:09 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 379/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:20:09 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 1541 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:20:09 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-unplugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:20:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:09 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:09 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] Creating event network-vif-unplugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:20:09 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029168 Apr 14 02:20:09 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 382/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:20:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 02:20:11 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-plugged", "status": "completed", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}, {"server_uuid": "3f1e74ea-fe8b-4c37-aa30-21f7e17db259", "name": "network-vif-deleted", "tag": "658d7098-ff69-45ed-8875-15a23a6bdb98"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:20:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:11 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] Creating event network-vif-plugged:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:20:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] Creating event network-vif-deleted:658d7098-ff69-45ed-8875-15a23a6bdb98 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 on user Apr 14 02:20:11 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050710 Apr 14 02:20:11 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 378/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:20:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=4 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=12 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:20:32 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 HTTP/1.1 Apr 14 02:20:32 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:20:32 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:20:32 user devstack@n-api.service[61837]: Connection: close Apr 14 02:20:32 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:20:32 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:20:32 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:20:32 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:20:32 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:20:32 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:20:32 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:20:32 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:20:32 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:20:32 user devstack@n-api.service[61837]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:20:32 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:20:32 user devstack@n-api.service[61837]: method: > Apr 14 02:20:32 user devstack@n-api.service[61837]: exception: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:20:32 user devstack@n-api.service[61837]: action_args: {'id': '5b243a71-802b-40f4-a374-16ecc2bae0f2'} Apr 14 02:20:32 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:20:32 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:20:32 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:20:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-df50f3db-a752-4d4e-91b4-92a619afd019 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2" status: 404 len: 111 microversion: 2.1 time: 0.043786 Apr 14 02:20:32 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 380/1140] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:20:32 2023] GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:20:32 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:32 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=8 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:32 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-2fafabfe-4e44-498a-b648-ddfca7fdc2d0 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '.version_select at 0x7fd420e27be0>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:20:32 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-2fafabfe-4e44-498a-b648-ddfca7fdc2d0 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-192458830" status: 202 len: 0 microversion: 2.1 time: 0.042660 Apr 14 02:20:32 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 383/1141] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 02:20:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-192458830 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:20:33 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:33 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:33 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-cc32d85d-5eb0-49d1-bba7-967aefde1f2c tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: .version_select at 0x7fd4211177f0>, body: {"keypair": {"name": "tempest-keypair-1626924443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPLfE1rE74YlC3HVCnY5X9V9ZRoJtteTcjHTuXtxQMXJGMfgwDqGgobT1jivwoFE8bcp3Yn7U5hUHqV4pZkavYxjmoni61h+szpfB3XYIKH4/0TcePqZHK+VUovC8PPgA=="}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:20:33 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-cc32d85d-5eb0-49d1-bba7-967aefde1f2c tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:20:33 user devstack@n-api.service[61835]: DEBUG nova.quota [None req-cc32d85d-5eb0-49d1-bba7-967aefde1f2c tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for user 168a0142cf984aacb1f087adcaa96468 and project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'key_pairs'} {{(pid=61835) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:20:33 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-cc32d85d-5eb0-49d1-bba7-967aefde1f2c tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.082337 Apr 14 02:20:33 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 379/1142] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 02:20:33 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-88389981", "imageRef": "b1bc26f9-63fb-4bff-8f72-f1e49544441d", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "981c880a-2147-4da6-8021-a03d0aee3f3d"}], "security_groups": [{"name": "tempest-securitygroup--711132185"}], "key_name": "tempest-keypair-1626924443", "user_data": "}} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.network.neutron [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] validate_networks() for [('981c880a-2147-4da6-8021-a03d0aee3f3d', None, None, None, None, None)] {{(pid=61837) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image limits 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image pref 0:0:0 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.quota [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting quotas for user 168a0142cf984aacb1f087adcaa96468 and project 0dcde6e918d64d70b69d2d81e1bdbe79. Resources: {'ram', 'cores', 'instances'} {{(pid=61837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Going to run 1 instances... {{(pid=61837) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 02:20:35 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1bc26f9-63fb-4bff-8f72-f1e49544441d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 02:20:35 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.734838 Apr 14 02:20:35 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 381/1143] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 02:20:35 2023] POST /compute/v2.1/servers => generated 399 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 02:20:36 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-fd6e3f94-a53b-4338-9827-3eccbb2dd78b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:20:36 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-fd6e3f94-a53b-4338-9827-3eccbb2dd78b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:20:36 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-fd6e3f94-a53b-4338-9827-3eccbb2dd78b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:20:36 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-fd6e3f94-a53b-4338-9827-3eccbb2dd78b tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" status: 200 len: 1234 microversion: 2.1 time: 0.070710 Apr 14 02:20:36 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 384/1144] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:20:35 2023] GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => generated 1234 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:20:38 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f", "tag": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:20:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:38 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:38 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] Creating event network-changed:08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f on user Apr 14 02:20:38 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031034 Apr 14 02:20:38 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 380/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:20:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:20:40 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f", "name": "network-vif-plugged", "status": "completed", "tag": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:20:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:40 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] Creating event network-vif-plugged:08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f on user Apr 14 02:20:40 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034237 Apr 14 02:20:40 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 382/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:20:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:20:42 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f", "name": "network-vif-plugged", "status": "completed", "tag": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d"}]} {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:20:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:42 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.compute.server_external_events [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] Creating event network-vif-plugged:08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f on user Apr 14 02:20:42 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028672 Apr 14 02:20:42 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 385/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:20:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell0:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:20:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] HTTP exception thrown: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 could not be found. Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Request method failure captured: Apr 14 02:20:59 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 HTTP/1.1 Apr 14 02:20:59 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:20:59 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:20:59 user devstack@n-api.service[61835]: Connection: close Apr 14 02:20:59 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:20:59 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:20:59 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:20:59 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:20:59 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLXNOTOT2jqdBtIjnSShr1dCfOXpNhBeMaB1EJbmYEYUUjaoetdgf57CFmHoebJyiQ0LpkmWatJ_9BFSM9V18vl03n4UV50jp8dVeiLy3z09xo71Q6lkLdWTTgkztfKkCbu30PUejASEgS2Tuv1AzjxAAYb8DVzHBfplai0EsIFSZbM Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Project-Id: 20723e8ba2f5480b8c17e6c4fc8fff9f Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Project-Name: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/20723e8ba2f5480b8c17e6c4fc8fff9f"}]}] Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Tenant: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Tenant-Id: 20723e8ba2f5480b8c17e6c4fc8fff9f Apr 14 02:20:59 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1976287714 Apr 14 02:20:59 user devstack@n-api.service[61835]: X-User: tempest-TestMinimumBasicScenario-1976287714-project-member Apr 14 02:20:59 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:20:59 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:20:59 user devstack@n-api.service[61835]: X-User-Id: 19633f8d769c4e50b5e6c9a75497b510 Apr 14 02:20:59 user devstack@n-api.service[61835]: X-User-Name: tempest-TestMinimumBasicScenario-1976287714-project-member Apr 14 02:20:59 user devstack@n-api.service[61835]: method: > Apr 14 02:20:59 user devstack@n-api.service[61835]: exception: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 could not be found. Apr 14 02:20:59 user devstack@n-api.service[61835]: action_args: {'id': '3f1e74ea-fe8b-4c37-aa30-21f7e17db259'} Apr 14 02:20:59 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 could not be found. Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 could not be found. Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 could not be found. Apr 14 02:20:59 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:20:59 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Returning 404 to user: Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:20:59 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-16f9a8f6-683e-4667-8de8-a0007dc23c04 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259" status: 404 len: 111 microversion: 2.1 time: 0.038256 Apr 14 02:20:59 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 381/1148] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:20:59 2023] GET /compute/v2.1/servers/3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:20:59 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:59 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell0:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:59 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:59 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=6 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:20:59 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f14c4864-661f-457e-a2d5-602973a61e72 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Calling method '.version_select at 0x7fd421251360>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:20:59 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f14c4864-661f-457e-a2d5-602973a61e72 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-232131221" status: 202 len: 0 microversion: 2.1 time: 0.028936 Apr 14 02:20:59 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 383/1149] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 14 02:20:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-232131221 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell0:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:21:26 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:21:26 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-0be103dd-76bb-49c7-9bb5-80ed0b6a5bcd tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" status: 200 len: 1544 microversion: 2.1 time: 0.447334 Apr 14 02:21:26 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 386/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:21:26 2023] GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => generated 1544 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=2 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-26948221-c14a-44b7-9b98-6cc6e3838333 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-26948221-c14a-44b7-9b98-6cc6e3838333 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26948221-c14a-44b7-9b98-6cc6e3838333 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26948221-c14a-44b7-9b98-6cc6e3838333 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26948221-c14a-44b7-9b98-6cc6e3838333 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26948221-c14a-44b7-9b98-6cc6e3838333 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26948221-c14a-44b7-9b98-6cc6e3838333 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:26 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-26948221-c14a-44b7-9b98-6cc6e3838333 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:26 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-26948221-c14a-44b7-9b98-6cc6e3838333 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.102201 Apr 14 02:22:26 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 382/1151] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 02:22:26 2023] GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-interface => generated 283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:22:27 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f", "tag": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:22:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] Creating event network-changed:08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f on user Apr 14 02:22:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163154 Apr 14 02:22:27 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 384/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-fa52e33b-b10a-4dd5-beee-b97316717eea tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-fa52e33b-b10a-4dd5-beee-b97316717eea tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa52e33b-b10a-4dd5-beee-b97316717eea tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa52e33b-b10a-4dd5-beee-b97316717eea tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa52e33b-b10a-4dd5-beee-b97316717eea tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa52e33b-b10a-4dd5-beee-b97316717eea tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa52e33b-b10a-4dd5-beee-b97316717eea tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:28 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-fa52e33b-b10a-4dd5-beee-b97316717eea tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:28 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-fa52e33b-b10a-4dd5-beee-b97316717eea tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/ips" status: 200 len: 149 microversion: 2.1 time: 0.041415 Apr 14 02:22:28 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 387/1153] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 02:22:28 2023] GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:22:31 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24bbdf6a-5311-490b-bece-4364727d75d9"}} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:22:31 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:22:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:31 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:31 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281726 Apr 14 02:22:31 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 383/1154] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 02:22:31 2023] POST /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:39 user devstack@n-api.service[61837]: DEBUG nova.objects.instance [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'services' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=61837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 02:22:39 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-volume_attachments/24bbdf6a-5311-490b-bece-4364727d75d9" status: 202 len: 0 microversion: 2.1 time: 0.223808 Apr 14 02:22:39 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 385/1155] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 02:22:39 2023] DELETE /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-volume_attachments/24bbdf6a-5311-490b-bece-4364727d75d9 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:22:39 user devstack@n-api.service[61836]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7e227dc-6291-47fc-b0fd-99f070ab1af8] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-752104ea-cd18-4e71-8b01-b029356c3792 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-752104ea-cd18-4e71-8b01-b029356c3792 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=4 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-752104ea-cd18-4e71-8b01-b029356c3792 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-752104ea-cd18-4e71-8b01-b029356c3792 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-752104ea-cd18-4e71-8b01-b029356c3792 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-752104ea-cd18-4e71-8b01-b029356c3792 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-752104ea-cd18-4e71-8b01-b029356c3792 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:22:39 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-752104ea-cd18-4e71-8b01-b029356c3792 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:22:39 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-752104ea-cd18-4e71-8b01-b029356c3792 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049321 Apr 14 02:22:39 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 388/1156] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:22:39 2023] GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-03856db6-7023-4c5e-9973-cf135316cc76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-03856db6-7023-4c5e-9973-cf135316cc76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-03856db6-7023-4c5e-9973-cf135316cc76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-03856db6-7023-4c5e-9973-cf135316cc76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-03856db6-7023-4c5e-9973-cf135316cc76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-03856db6-7023-4c5e-9973-cf135316cc76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-03856db6-7023-4c5e-9973-cf135316cc76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:23:29 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-03856db6-7023-4c5e-9973-cf135316cc76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:23:29 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-03856db6-7023-4c5e-9973-cf135316cc76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052075 Apr 14 02:23:29 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 384/1157] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 02:23:29 2023] GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 02:23:29 user devstack@n-api.service[61837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 02:23:29 user devstack@n-api.service[61837]: Fri Apr 14 02:23:29 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f (ip 10.0.0.210) !!! Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=2 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:23:29 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Going to try to terminate instance {{(pid=61837) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 02:23:29 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" status: 204 len: 0 microversion: 2.1 time: 0.125490 Apr 14 02:23:29 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 386/1158] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:23:29 2023] DELETE /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:23:29 user devstack@n-api.service[61836]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7e227dc-6291-47fc-b0fd-99f070ab1af8] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47634. Apr 14 02:23:29 user devstack@n-api.service[61836]: DEBUG nova.policy [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61836) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 02:23:29 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-d82a2bd6-3f26-47f1-9fc8-d7a784c2a5fa tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" status: 200 len: 1669 microversion: 2.1 time: 0.259795 Apr 14 02:23:29 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 389/1159] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:23:29 2023] GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => generated 1669 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 02:23:30 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f", "name": "network-vif-unplugged", "status": "completed", "tag": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d"}]} {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:23:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:23:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:23:30 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:23:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.compute.server_external_events [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] Creating event network-vif-unplugged:08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f on user Apr 14 02:23:30 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140506 Apr 14 02:23:30 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 385/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:23:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:23:32 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f", "name": "network-vif-plugged", "status": "completed", "tag": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d"}, {"server_uuid": "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f", "name": "network-vif-deleted", "tag": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d"}]} {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 02:23:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:23:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:23:32 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:23:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] Creating event network-vif-plugged:08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f on user Apr 14 02:23:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.compute.server_external_events [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] Creating event network-vif-deleted:08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f on user Apr 14 02:23:32 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034728 Apr 14 02:23:32 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 387/1161] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 02:23:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_api:SELECT=2 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG dbcounter [-] [61836] Writing DB stats nova_cell1:SELECT=6 {{(pid=61836) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:24:20 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f HTTP/1.1 Apr 14 02:24:20 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:24:20 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:24:20 user devstack@n-api.service[61836]: Connection: close Apr 14 02:24:20 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:24:20 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:24:20 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:24:20 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:24:20 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:20 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:20 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:20 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:24:20 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:24:20 user devstack@n-api.service[61836]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:24:20 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:20 user devstack@n-api.service[61836]: method: > Apr 14 02:24:20 user devstack@n-api.service[61836]: exception: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:20 user devstack@n-api.service[61836]: action_args: {'id': 'ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f'} Apr 14 02:24:20 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:20 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:20 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:24:20 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-7e13fb8b-8d7a-4f03-8864-57c316561cc9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" status: 404 len: 111 microversion: 2.1 time: 0.035374 Apr 14 02:24:20 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 390/1162] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:24:20 2023] GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:24:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_api:SELECT=4 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:20 user devstack@n-api.service[61835]: DEBUG dbcounter [-] [61835] Writing DB stats nova_cell1:SELECT=8 {{(pid=61835) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:20 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-34b78e45-8977-48cd-b2f5-d70abe128c58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '.version_select at 0x7fd420ed7d90>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:20 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-34b78e45-8977-48cd-b2f5-d70abe128c58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626924443" status: 202 len: 0 microversion: 2.1 time: 0.032003 Apr 14 02:24:20 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 386/1163] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 02:24:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626924443 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG dbcounter [-] [61837] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61837) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:24:24 user devstack@n-api.service[61837]: request: DELETE /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f HTTP/1.1 Apr 14 02:24:24 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:24:24 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:24:24 user devstack@n-api.service[61837]: Connection: close Apr 14 02:24:24 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:24:24 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:24:24 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:24:24 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:24:24 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:24 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:24 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:24 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:24:24 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:24:24 user devstack@n-api.service[61837]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:24:24 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:24 user devstack@n-api.service[61837]: method: > Apr 14 02:24:24 user devstack@n-api.service[61837]: exception: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61837]: action_args: {'id': 'ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f'} Apr 14 02:24:24 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:24:24 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-dd9005fc-008b-422f-ab52-09cfb7b694b9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" status: 404 len: 111 microversion: 2.1 time: 0.038825 Apr 14 02:24:24 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 388/1164] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:24:24 2023] DELETE /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:24:24 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f HTTP/1.1 Apr 14 02:24:24 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:24:24 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:24:24 user devstack@n-api.service[61836]: Connection: close Apr 14 02:24:24 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:24:24 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:24:24 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:24:24 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:24:24 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:24 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:24 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:24 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:24:24 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:24:24 user devstack@n-api.service[61836]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:24:24 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:24 user devstack@n-api.service[61836]: method: > Apr 14 02:24:24 user devstack@n-api.service[61836]: exception: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61836]: action_args: {'id': 'ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f'} Apr 14 02:24:24 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. Apr 14 02:24:24 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:24 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:24:24 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-7efd46d8-74b9-4e91-bbdd-fe3194edb77f tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" status: 404 len: 111 microversion: 2.1 time: 0.029121 Apr 14 02:24:24 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 391/1165] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:24:24 2023] GET /compute/v2.1/servers/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:24:27 user devstack@n-api.service[61835]: request: DELETE /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 HTTP/1.1 Apr 14 02:24:27 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:24:27 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:24:27 user devstack@n-api.service[61835]: Connection: close Apr 14 02:24:27 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:24:27 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:24:27 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:24:27 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:24:27 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:27 user devstack@n-api.service[61835]: method: > Apr 14 02:24:27 user devstack@n-api.service[61835]: exception: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: action_args: {'id': '5b243a71-802b-40f4-a374-16ecc2bae0f2'} Apr 14 02:24:27 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:24:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-1ef7a37a-7a80-47e3-afd3-d3616d6235de tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2" status: 404 len: 111 microversion: 2.1 time: 0.031595 Apr 14 02:24:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 387/1166] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:24:27 2023] DELETE /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:24:27 user devstack@n-api.service[61837]: request: GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 HTTP/1.1 Apr 14 02:24:27 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:24:27 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:24:27 user devstack@n-api.service[61837]: Connection: close Apr 14 02:24:27 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:24:27 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:24:27 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:24:27 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:24:27 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:27 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:27 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:24:27 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:24:27 user devstack@n-api.service[61837]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:24:27 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:27 user devstack@n-api.service[61837]: method: > Apr 14 02:24:27 user devstack@n-api.service[61837]: exception: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61837]: action_args: {'id': '5b243a71-802b-40f4-a374-16ecc2bae0f2'} Apr 14 02:24:27 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:24:27 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-22c9f01b-0b78-43c7-91b5-cc79f64d8f76 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2" status: 404 len: 111 microversion: 2.1 time: 0.032401 Apr 14 02:24:27 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 389/1167] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:24:27 2023] GET /compute/v2.1/servers/5b243a71-802b-40f4-a374-16ecc2bae0f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:27 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:24:27 user devstack@n-api.service[61836]: request: DELETE /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 HTTP/1.1 Apr 14 02:24:27 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:24:27 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:24:27 user devstack@n-api.service[61836]: Connection: close Apr 14 02:24:27 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:24:27 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:24:27 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:24:27 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:24:27 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:27 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:27 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:24:27 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:24:27 user devstack@n-api.service[61836]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:24:27 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:27 user devstack@n-api.service[61836]: method: > Apr 14 02:24:27 user devstack@n-api.service[61836]: exception: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61836]: action_args: {'id': '5728d5fc-4f3a-43af-b7a3-16c359bfd589'} Apr 14 02:24:27 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:24:27 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-4295dc03-ebbc-4d18-af02-f78d6277ead5 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589" status: 404 len: 111 microversion: 2.1 time: 0.027795 Apr 14 02:24:27 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 392/1168] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:24:27 2023] DELETE /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG nova.compute.api [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Fetching instance by UUID {{(pid=61835) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG oslo_concurrency.lockutils [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61835) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.wsgi [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:24:27 user devstack@n-api.service[61835]: request: GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 HTTP/1.1 Apr 14 02:24:27 user devstack@n-api.service[61835]: Accept: application/json Apr 14 02:24:27 user devstack@n-api.service[61835]: Accept-Encoding: identity Apr 14 02:24:27 user devstack@n-api.service[61835]: Connection: close Apr 14 02:24:27 user devstack@n-api.service[61835]: Content-Length: 0 Apr 14 02:24:27 user devstack@n-api.service[61835]: Content-Type: application/json Apr 14 02:24:27 user devstack@n-api.service[61835]: Host: 10.0.0.210 Apr 14 02:24:27 user devstack@n-api.service[61835]: Openstack-System-Scope: None Apr 14 02:24:27 user devstack@n-api.service[61835]: User-Agent: python-urllib3/1.26.15 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Domain-Id: None Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Domain-Name: None Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Identity-Status: Confirmed Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Is-Admin-Project: True Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Project-Domain-Id: default Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Project-Domain-Name: Default Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Role: reader,member Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Roles: reader,member Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User-Domain-Id: default Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User-Domain-Name: Default Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:24:27 user devstack@n-api.service[61835]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:27 user devstack@n-api.service[61835]: method: > Apr 14 02:24:27 user devstack@n-api.service[61835]: exception: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: action_args: {'id': '5728d5fc-4f3a-43af-b7a3-16c359bfd589'} Apr 14 02:24:27 user devstack@n-api.service[61835]: {{(pid=61835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. Apr 14 02:24:27 user devstack@n-api.service[61835]: ERROR nova.api.openstack.wsgi Apr 14 02:24:27 user devstack@n-api.service[61835]: DEBUG nova.api.openstack.wsgi [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 could not be found. {{(pid=61835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:24:27 user devstack@n-api.service[61835]: INFO nova.api.openstack.requestlog [None req-00fe9ccf-d5bf-418b-b6b8-8ef280cd70c2 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589" status: 404 len: 111 microversion: 2.1 time: 0.064868 Apr 14 02:24:27 user devstack@n-api.service[61835]: [pid: 61835|app: 0|req: 388/1169] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:24:27 2023] GET /compute/v2.1/servers/5728d5fc-4f3a-43af-b7a3-16c359bfd589 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:24:30 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:30 user devstack@n-api.service[61837]: DEBUG nova.compute.api [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61837) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:24:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:31 user devstack@n-api.service[61837]: DEBUG oslo_concurrency.lockutils [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61837) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:31 user devstack@n-api.service[61837]: INFO nova.api.openstack.wsgi [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:24:31 user devstack@n-api.service[61837]: request: DELETE /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 HTTP/1.1 Apr 14 02:24:31 user devstack@n-api.service[61837]: Accept: application/json Apr 14 02:24:31 user devstack@n-api.service[61837]: Accept-Encoding: identity Apr 14 02:24:31 user devstack@n-api.service[61837]: Connection: close Apr 14 02:24:31 user devstack@n-api.service[61837]: Content-Length: 0 Apr 14 02:24:31 user devstack@n-api.service[61837]: Content-Type: application/json Apr 14 02:24:31 user devstack@n-api.service[61837]: Host: 10.0.0.210 Apr 14 02:24:31 user devstack@n-api.service[61837]: Openstack-System-Scope: None Apr 14 02:24:31 user devstack@n-api.service[61837]: User-Agent: python-urllib3/1.26.15 Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Domain-Id: None Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Domain-Name: None Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Identity-Status: Confirmed Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Is-Admin-Project: True Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Project-Domain-Id: default Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Project-Domain-Name: Default Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Role: reader,member Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Roles: reader,member Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:31 user devstack@n-api.service[61837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:31 user devstack@n-api.service[61837]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:31 user devstack@n-api.service[61837]: X-User-Domain-Id: default Apr 14 02:24:31 user devstack@n-api.service[61837]: X-User-Domain-Name: Default Apr 14 02:24:31 user devstack@n-api.service[61837]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:24:31 user devstack@n-api.service[61837]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:31 user devstack@n-api.service[61837]: method: > Apr 14 02:24:31 user devstack@n-api.service[61837]: exception: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61837]: action_args: {'id': '21ac5dda-cff9-4da5-a19d-49b74491f007'} Apr 14 02:24:31 user devstack@n-api.service[61837]: {{(pid=61837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61837]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61837]: DEBUG nova.api.openstack.wsgi [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. {{(pid=61837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:24:31 user devstack@n-api.service[61837]: INFO nova.api.openstack.requestlog [None req-d45f2c4c-8494-48aa-9061-4346fe913b74 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007" status: 404 len: 111 microversion: 2.1 time: 0.032052 Apr 14 02:24:31 user devstack@n-api.service[61837]: [pid: 61837|app: 0|req: 390/1170] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 02:24:30 2023] DELETE /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Calling method '>' {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG nova.compute.api [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Fetching instance by UUID {{(pid=61836) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG oslo_concurrency.lockutils [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "e086e9f0-6c9d-428f-aa45-eca1382cde59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61836) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 02:24:31 user devstack@n-api.service[61836]: INFO nova.api.openstack.wsgi [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HTTP exception thrown: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Request method failure captured: Apr 14 02:24:31 user devstack@n-api.service[61836]: request: GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 HTTP/1.1 Apr 14 02:24:31 user devstack@n-api.service[61836]: Accept: application/json Apr 14 02:24:31 user devstack@n-api.service[61836]: Accept-Encoding: identity Apr 14 02:24:31 user devstack@n-api.service[61836]: Connection: close Apr 14 02:24:31 user devstack@n-api.service[61836]: Content-Length: 0 Apr 14 02:24:31 user devstack@n-api.service[61836]: Content-Type: application/json Apr 14 02:24:31 user devstack@n-api.service[61836]: Host: 10.0.0.210 Apr 14 02:24:31 user devstack@n-api.service[61836]: Openstack-System-Scope: None Apr 14 02:24:31 user devstack@n-api.service[61836]: User-Agent: python-urllib3/1.26.15 Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Auth-Token: gAAAAABkOLYJeW_b9xjKIfuWH2OPpKwONCstB3Kpfev9FG03qFexCz201m9RdaC96kWLscIaAtSH1_KQcUsbKHx7Zppeq63jU7MBoI-fT1kAh5JIStTdVFbs-NEpBY_im9NyeHRgMLmvyMQXM_RIloWTwvsY-ZPblgwDpDwRtULu2HKIy-qxLt8 Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Domain-Id: None Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Domain-Name: None Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Identity-Status: Confirmed Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Is-Admin-Project: True Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Project-Domain-Id: default Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Project-Domain-Name: Default Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Project-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Role: reader,member Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Roles: reader,member Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0dcde6e918d64d70b69d2d81e1bdbe79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0dcde6e918d64d70b69d2d81e1bdbe79"}]}] Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Tenant: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Tenant-Id: 0dcde6e918d64d70b69d2d81e1bdbe79 Apr 14 02:24:31 user devstack@n-api.service[61836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1854704348 Apr 14 02:24:31 user devstack@n-api.service[61836]: X-User: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:31 user devstack@n-api.service[61836]: X-User-Domain-Id: default Apr 14 02:24:31 user devstack@n-api.service[61836]: X-User-Domain-Name: Default Apr 14 02:24:31 user devstack@n-api.service[61836]: X-User-Id: 168a0142cf984aacb1f087adcaa96468 Apr 14 02:24:31 user devstack@n-api.service[61836]: X-User-Name: tempest-AttachVolumeNegativeTest-1854704348-project-member Apr 14 02:24:31 user devstack@n-api.service[61836]: method: > Apr 14 02:24:31 user devstack@n-api.service[61836]: exception: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61836]: action_args: {'id': '21ac5dda-cff9-4da5-a19d-49b74491f007'} Apr 14 02:24:31 user devstack@n-api.service[61836]: {{(pid=61836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. Apr 14 02:24:31 user devstack@n-api.service[61836]: ERROR nova.api.openstack.wsgi Apr 14 02:24:31 user devstack@n-api.service[61836]: DEBUG nova.api.openstack.wsgi [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Returning 404 to user: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. {{(pid=61836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 02:24:31 user devstack@n-api.service[61836]: INFO nova.api.openstack.requestlog [None req-20715985-12cd-4c4f-b295-e45ca055f438 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007" status: 404 len: 111 microversion: 2.1 time: 0.028344 Apr 14 02:24:31 user devstack@n-api.service[61836]: [pid: 61836|app: 0|req: 393/1171] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 02:24:31 2023] GET /compute/v2.1/servers/21ac5dda-cff9-4da5-a19d-49b74491f007 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)